#tfl@irc.freenode.net logs for 10 Jan 2007 (GMT)

Archive Today Yesterday Tomorrow
tfl homepage


[00:00:24] --> wizardrydragon has joined #tfl
[00:00:30] --- ChanServ gives voice to wizardrydragon
[00:51:56] <-- wizardrydragon has left IRC (Excess Flood)
[00:52:07] --> wizardrydragon has joined #tfl
[00:52:11] --- ChanServ gives voice to wizardrydragon
[00:52:18] <-- wizardrydragon has left IRC (Excess Flood)
[00:52:54] --> wizardrydragon has joined #tfl
[00:52:54] --- ChanServ gives voice to wizardrydragon
[04:24:42] --- Eagle_101 is now known as EagleZzZ
[09:33:05] <-- wizardrydragon has left IRC (Read error: 110 (Connection timed out))
[12:13:55] <-- Kirben has left IRC (Read error: 145 (Connection timed out))
[17:04:10] --> wizardrydragon has joined #tfl
[17:04:14] --- ChanServ gives voice to wizardrydragon
[17:08:21] --> servus_ has joined #tfl
[17:25:49] <-- servus_ has left IRC (Read error: 110 (Connection timed out))
[17:26:00] <-- servus has left IRC (Read error: 110 (Connection timed out))
[17:33:50] <-- wizardrydragon has left IRC (Read error: 110 (Connection timed out))
[18:52:54] --> wizardrydragon has joined #tfl
[18:52:58] --- ChanServ gives voice to wizardrydragon
[18:53:04] <-- wizardrydragon has left IRC (Excess Flood)
[18:56:21] --> wizardrydragon has joined #tfl
[18:56:21] --- ChanServ gives voice to wizardrydragon
[21:58:27] --> Kirben has joined #tfl
[21:58:27] --- ChanServ gives voice to Kirben
[22:09:43] --- EagleZzZ is now known as Eagle_101
[22:15:36] --> Marzo has joined #tfl
[22:15:36] --- ChanServ gives voice to Marzo
[22:15:49] <Marzo> Hi
[22:16:00] <wizardrydragon> Woah look who decided to show up.
[22:16:02] <wizardrydragon> :)
[22:16:06] <Marzo> :-)
[22:16:20] <Marzo> I can see that this channel is dead when I am not here :-)
[22:16:30] <wizardrydragon> I think I actually made a commit and you missed it, too.
[22:18:11] <Marzo> No, you did not
[22:18:35] <Marzo> (unless it was today)
[22:19:45] <wizardrydragon> Or I meant to but forgot (also likely)
[22:20:02] <wizardrydragon> Ive actually been fairly prolific worldbuilding as of late.
[22:22:24] <Marzo> I have done a few commits, don't know if you noticed them
[22:22:34] <Marzo> (mostly bug fixes inherited from Keyring mod)
[22:23:26] <wizardrydragon> :)
[22:23:29] <wizardrydragon> I did.
[22:31:04] --> dragonBot has joined #tfl
[22:31:04] --- ChanServ gives voice to dragonBot
[22:31:22] <wizardrydragon> It lives :)
[22:31:30] <Marzo> :-)
[22:31:37] <wizardrydragon> !dragonBot auth user add u=Marzo r=Trusted x=60 l=1
[22:31:40] <dragonBot> Marzo has been successfully added to the bot authentication database at permission level 1.
[22:31:58] <wizardrydragon> Knock yourself out, though it doesn't do much right now.
[22:32:07] <Marzo> I figured
[22:32:29] <Marzo> (I also have been looking a bit at the dragonBot CVS logs)
[22:32:38] <wizardrydragon> Lol
[22:32:47] <wizardrydragon> !dragonBot diff parse url=http://en.wikipedia.org/w/index.php?title=Wikipedia%3ARequests_for_adminship%2FProtectionBot&diff=99856634&oldid=99854989
[22:32:49] <dragonBot> I am now getting and parsing this url: http://en.wikipedia.org/w/api.php?action=query&format=xml&prop=revisions&titles=Wikipedia%3ARequests_for_adminship%2FProtectionBot&rvlimit=2&rvprop=timestamp|user|comment|content&rvstartid=99856634&rvendid=99854989
[22:32:52] <dragonBot> UserB: Dar-Ape UserA: RyanGerbil10 SummaryB: /* Oppose */ oops- link SummaryA: striking likely sock vote
[22:32:55] <dragonBot> TimeB: 10/01/2007 10:05:56 PM TimeA: html.ReadDiff LengthB: 235680 WordsB: 39015 LinesB: 749
[22:32:58] <dragonBot> LengthA: 235701 WordsA: 39019 LinesA: 749LengthChanged: 21 WordsChanged: 4 LinesChanged: 0
[22:33:01] <dragonBot> Time to get and parse the diffs: 2 ms. Time to analyze diff stats: 466 ms. Time to report stats: 271 ms. Total time: 739 ms.
[22:33:34] <Marzo> Hey, it does something! :-)
[22:33:47] <wizardrydragon> :)
[22:38:04] <wizardrydragon> Ill be getting a Wikipedia toolserver account and can stick it up there soon, then it will be up 24/7 except for updates.
[22:51:26] <Eagle_101> Marzo um there is some tfl commands on it
[22:51:34] <Eagle_101> !dragonbot web
[22:51:38] <Eagle_101> !dragonbot website
[22:51:45] <Eagle_101> !dragonBot website
[22:51:49] <dragonBot> The Ultima VII: The Feudal Lands website may be found at http://www.u7feudallands.com
[22:52:06] <wizardrydragon> !dragonBot commands
[22:52:27] <Eagle_101> does not work in here, you have to set the tfl version I think (I don't remember how I set that up)
[22:52:28] <-- dragonBot has left IRC (Read error: 131 (Connection reset by peer))
[22:52:39] <wizardrydragon> You didnt.
[22:52:40] <wizardrydragon> Heh
[22:52:47] <Eagle_101> :P
[22:52:56] <wizardrydragon> Dammit I didnt mean to close the dragonBot window.
[22:56:13] <Eagle_101> heh
[22:56:17] <Eagle_101> pitty on you
[22:57:09] <Eagle_101> wizardrydragon you know... the little "x" means close, not a subsitute for multiply (or the keyboard button "x"). Pressing it before you are read is generally known as a "Bad" thing. :D
[22:59:02] <wizardrydragon> No there was a MSN window by it that I wanted to close, but I missed :P
[23:08:38] <Eagle_101> wizardrydragon you are never going to believe this... but toolserve is catching up to wikipedia! http://tools.wikimedia.de/~leon/stats/replag/all/replag-monthly.png
[23:08:47] <wizardrydragon> :)
[23:08:58] <wizardrydragon> 10[10/01/2007 18:08 EST-5] replagbot: 01wizardrydragon: current replication lag: 1d 8h 25m 39s (116739s)
[23:09:16] <Eagle_101> um... really?
[23:09:19] <Eagle_101> not by that picture
[23:09:25] <wizardrydragon> Thats the live data.
[23:09:27] <Eagle_101> we are um... /me checks calculations
[23:09:41] <Eagle_101> um that image is only behind by like a few minutes
[23:09:41] <wizardrydragon> As of 18:08 UTC today.
[23:09:51] <wizardrydragon> Which is precisely a minute ago.
[23:09:59] <Eagle_101> mmm ok :S
[23:10:04] * Eagle_101 will check the image :D
[23:10:45] <wizardrydragon> Thats just for zedler Eagle
[23:10:53] <wizardrydragon> There's Hemlock too
[23:10:58] <Eagle_101> there you go :D I am talking about ariel(en)
[23:11:07] <wizardrydragon> Nono
[23:11:11] <wizardrydragon> There are two server farms
[23:11:13] <wizardrydragon> Zelder
[23:11:15] <wizardrydragon> And Hemlock
[23:11:19] <wizardrydragon> That is the Zedler farm
[23:11:24] <wizardrydragon> Which has three servs
[23:11:37] <Eagle_101> mmm ok?
[23:12:08] <wizardrydragon> Zedler is a farm of three servers designated Ariel Adler and Henbane
[23:12:11] <Eagle_101> so what server would it be reporting, the en lag as of this image is like 1240727
[23:12:25] <wizardrydragon> Ariel is for EN
[23:12:26] <Eagle_101> which would be Ariel
[23:12:34] <wizardrydragon> Henbane is for Asia
[23:12:40] <Eagle_101> yeah image tells me :D
[23:12:43] <wizardrydragon> and Adler is for ... everything else.
[23:12:44] <Eagle_101> thanks :D
[23:12:58] * wizardrydragon is a toolserv junkie what can he say.
[23:13:03] <Eagle_101> lol
[23:13:33] <Eagle_101> the image shows shows that we could be all caught up (ariel) in 3-4 weeks
[23:15:04] <wizardrydragon> Zedler will yes.
[23:15:35] <wizardrydragon> Hemlock is still significantly behind, because it has the actual dump, and it has to replicate the whole wikipedia.
[23:15:53] <Eagle_101> and adler?
[23:15:57] <Eagle_101> ariel
[23:15:57] <wizardrydragon> Nono.
[23:15:58] <Eagle_101> sorry
[23:16:04] <wizardrydragon> Hemlock is the main WP farm.
[23:16:08] <wizardrydragon> Zedler is the secondary.
[23:16:14] <Eagle_101> ah :S
[23:16:23] <Eagle_101> can I see the replag for Hemlock?
[23:16:31] <wizardrydragon> Thats what I posted above ^^
[23:16:41] <wizardrydragon> 10[10/01/2007 18:16 EST-5] replagbot: 01wizardrydragon: current replication lag: 1d 8h 23m 30s (116610s)
[23:16:52] <Eagle_101> heh
[23:16:58] <Eagle_101> so en is now only a day behind?
[23:17:51] <wizardrydragon> Full replication of EN is 1d 8h 23m 30s behind.
[23:18:00] <Eagle_101> nice!
[23:18:11] <Eagle_101> I thought it was much more dreadful then that
[23:18:14] <wizardrydragon> Full replication on Hemlock is the full HTML, and is fully browsable/whatever
[23:18:32] <wizardrydragon> Partial replication on Zedler is the XML feeds api.php uses.
[23:18:48] <wizardrydragon> Zedler is where most toolserv stuff goes, since bots and tools generally just use api.php
[23:18:55] <Eagle_101> ah I see, well the partial replication is 14 days behind
[23:19:09] <wizardrydragon> Yes.
[23:19:46] <wizardrydragon> Right now most just ping api.php on Knams which is the public HTTP far,
[23:20:06] <Eagle_101> and it is fully caught up/
[23:20:10] <wizardrydragon> Knams is the main farm and what youre pinging when you browse Wikipedia
[23:20:22] <wizardrydragon> So yeah of course it is.
[23:20:33] <Eagle_101> heh
[23:20:51] <Eagle_101> and the purpose of the second farm is to keep the bots off the main farm right?
[23:20:54] <wizardrydragon> Its a matter of backpassing the data to Zedler and Hemlock which is being tightened up.
[23:21:17] <wizardrydragon> Zedler and Hemlock are segregated for Knams for a few reason
[23:21:42] <wizardrydragon> For one its because the German office has its own farm, and thats Zedler, so geographically it's segregated
[23:22:04] <wizardrydragon> For two its because they dont want a bot malfunctioning to throw all of the Wikipedias for a loop.
[23:22:29] <Eagle_101> mmm, well all the bots are pinging the main farm anyway >.>
[23:22:43] <wizardrydragon> Yes, but if they error out, or go in an infinite loop ...
[23:22:50] <Eagle_101> yeah lol
[23:22:52] <wizardrydragon> Then its better just Zedler goes blah than Knams
[23:23:32] <Eagle_101> yeah, but since that is not actually happening (bots are using Knams), there is little point unless they bother to catch the replag back up.
[23:23:46] <wizardrydragon> Not at all Eagle
[23:24:00] <wizardrydragon> Right now if a bot dies, the worst it can do is take down Zedler
[23:24:13] <wizardrydragon> Knams would be unaffected
[23:24:23] <wizardrydragon> The bot is running on the Perl or python or PHP on Zedler
[23:24:25] <wizardrydragon> Not Knams
[23:24:52] <Eagle_101> ah, so that is why they are all behind by 14 days or whatever?
[23:25:19] <wizardrydragon> Yes and know.
[23:25:32] <wizardrydragon> If it was passing back data on realtime
[23:25:42] <wizardrydragon> Wikipedia would be somewheres around 600% slower.
[23:26:12] <wizardrydragon> Its a balancing act of the bots having up to date dumps versus the strain on the main server farm
[23:26:27] <Eagle_101> I see, though it used to be fairly caught up
[23:26:44] <Eagle_101> then something went wrong with the en stuff, and that blew up
[23:26:57] <Eagle_101> while the other stuff has about a 1 day lag
[23:26:58] <wizardrydragon> It comes and goes as the developers mess things up :)
[23:27:07] <Eagle_101> heh
[23:27:13] * Eagle_101 is looking at the replag logs
[23:27:42] <Eagle_101> around week 52
[23:27:45] <Eagle_101> around week 51
[23:28:03] <Eagle_101> the en part of the servers went bad
[23:28:12] <Eagle_101> .2 million seconds
[23:28:41] <Eagle_101> and by the end of week 01 it was at 1.6 million seconds
[23:29:11] <wizardrydragon> Yeah
[23:29:30] <wizardrydragon> Vandalism and spam spikes put a dent in the replag too
[23:29:50] <Eagle_101> heh :S well it is catching back up, dispite the recent spates in vandalism
[23:30:17] <Eagle_101> but I will say one thing... the en replag functons is oddly lineir
[23:30:29] <wizardrydragon> Heh
[23:30:31] <Eagle_101> up till about 2 days before the end of week 01
[23:30:47] <wizardrydragon> I dont pay much attention except insofar as it affects my bots heh
[23:31:00] <Eagle_101> heh, /me is just playing with the math >.>