IRC logs continuity after BotBot.me shutdown

[Harnum, Alan]

Hi Justin,

Thanks for the feedback and requests. My thoughts:


  *   I will definitely see about combining the BotBot logs with the older logs at https://wiki.fluidproject.org/display/fluid/fluid-work+IRC+Logs and https://wiki.fluidproject.org/display/fluid/fluid-tech+IRC+Logs – I’m uncertain how much work will be involved in finding a way to automatically create the same structure, as I don’t want to manually create 1000+ individual pages for each day of the logs. It looks like the existing pages were created by “Fluid IRC Log Bot”, so there should be some way to automate this process in Confluence.
  *   Currently, the logs at http://irc-logs.fluidproject.org/ are the raw output of the ChannelLogger plug-in. We should be able to implement some kind of rotation script or similar, or perhaps find a way to create wiki pages from them automatically per the first bullet.
  *   The ChannelLogger log files are plain text, with each line of IRC activity on its own line with a ISO 8601 timestamp. They’re basic, but a parser could be written to render them into other formats.

From: Justin Obara <obara.justin at gmail.com>
Date: Monday, September 24, 2018 at 7:12 AM
To: "Harnum, Alan" <aharnum at ocadu.ca>
Cc: Fluid Work <fluid-work at fluidproject.org>
Subject: Re: IRC logs continuity after BotBot.me shutdown

Hi Alan,

Thanks for taking this on and working to ensure that continuity of our logs. Two requests, which you may already be working on:


  *   combine the botbot logs with the ones from fluid-log so that we have a single place to find everything
  *   can you output the list of logs (e.g. http://irc-logs.fluidproject.org/%23fluid-work/ ) with the most recent at the top and/or break them out by year/month/day so that the we don’t have a very long page of logs eventually?
Are the logs captured in any sort of data structure, or is the logger just literally copying all of the text?

Thanks
Justin



On September 21, 2018 at 5:07:31 PM, Harnum, Alan (aharnum at ocadu.ca<mailto:aharnum at ocadu.ca>) wrote:
As many of you know already, the (free) BotBot.me logging service we use to log our IRC channels is shutting down in early November: https://lincolnloop.com/blog/saying-goodbye-botbotme/

PLANS FOR PRESERVING THE LAST SEVERAL YEARS OF LOGS

I’ve been in contact with the BotBot.me operators and they provided me with a script to download our logs in bulk. I’ve done this already once to make sure it works, and will do it again closer to the time of shutdown.

The logs are extremely basic (a single large text dump for each channel) and will likely require some parsing and re-presentation to be useful. If anyone is interested in seeing the raw logs now, let me know and I can share a private GitHub repo with you.

PLANS FOR IRC LOGGING GOING FORWARD

The plan for logging continuity at the moment is to run a simple logging bot and serve its log through a web server. This is basic but can be executed with reasonable speed so we’ve got some overlap between this solution and the BotBot shutdown in order to work out any challenges with this approach. We can look into

The bot is called “fluid-bot” and the (plaintext) logs are visible right now at http://irc-logs.fluidproject.org/ - please keep in mind this approach is still experimental and I can’t guarantee they’ll be comprehensive at this point – there’ll be some gaps in the next week as I work out any issues.

Please let me know if you have any questions or concerns with this approach.

ALAN HARNUM
SENIOR INCLUSIVE DEVELOPER
INCLUSIVE DESIGN RESEARCH CENTRE, OCAD UNIVERSITY

E aharnum at ocadu.ca<mailto:aharnum at ocadu.ca>
OCAD UNIVERSITY
100 McCaul Street, Toronto, Canada, M5T 1W1
www.ocadu.ca<http://ocadu.ca/>

_______________________________________________________
fluid-work mailing list - fluid-work at lists.idrc.ocad.ca<mailto:fluid-work at lists.idrc.ocad.ca>
To unsubscribe, change settings or access archives,
see https://lists.idrc.ocad.ca/mailman/listinfo/fluid-work
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.idrc.ocad.ca/pipermail/fluid-work/attachments/20180924/0a8bce65/attachment.html>