coffee

My Sunday

Have figured out how to get wget to use session cookies and mirror your entire LiveJournal site. Which means, the tool is logged in as you, so you get everything, private posts, flocked posts, and so on. Plus page requisites, so userpics are also saved. It was not immediately obvious how to do it, so I'm writing it up. The results are considerably more like what somebody might expect from a local archive of their site: with images and layout and so on.

If you know what you're doing with wget, the secret is to run it twice. Once to get a session cookie piggybacking on your browser's cookies, then again to mirror all the data. E.g.,
wget --cookies=on --keep-session-cookies --save-cookies wget_cookies.txt --load-cookies /path/to/firefox/cookies.txt --header "X-LJ-Auth: cookie" http://antennapedia.livejournal.com/
wget -r -l6 -H -Dstat.livejournal.com -Duserpic.livejournal.com -Dantennapedia.livejournal.com --page-requisites --convert-links -R "*mode=*,*replyto=*,*thread=*,*/friends*" --cookies=on --keep-session-cookies --save-cookies wget_cookies.txt --load-cookies wget_cookies.txt --header "X-LJ-Auth: cookie" http://antennapedia.livejournal.com/


I downloaded my entire freakin' LJ at least three times in the course of testing this and finding the perfect set of mirroring options. LJ's sysadmins have my permission to hate me.

Am now attempting to finish a first draft of "Thusia". This is two weeks early, thus giving me time to get my beta-reader's opinion, and avoid the problems that attended posting "Dust" in a three-quarters-finished state.

Why is it that finishing a story is always followed by this horrible down phase? Even when people mostly like it, I have this reaction. I'd like to skip it next time, please.

PS: If you enjoyed lolcode, you will need the definitive O'Rly guide. Oh, god, I might stop laughing this year.
  • Current Music: Go To The Mirror : The Who : Tommy
Tags: ,
Why is it that finishing a story is always followed by this horrible down phase? Even when people mostly like it, I have this reaction. I'd like to skip it next time, please.

Please insert my impersonation of Monica-on-Friends -- "I KNOW!!"-- here. It is a vile, vile feeling.

Happy drafting!
I am against it. I think we should apply sufficient quantities of adult beverage until it goes away. Either that or start another project.

Happy Monday!
Why is it that finishing a story is always followed by this horrible down phase?

Post-partum. Particularly if you've been working on it for awhile and/or intensely. Even if I hated the actual writing part, there's still a void there when it's gone...
Yeah, I guess it's the finished project syndrome. Only the writing is so close, so tangled up with every level of the mind. Maybe it's that all the possibilities are closed off?

Nothing to do but start another one and not dwell on it.
The advice of a reader - Write in the Blackmailverse. Go play with Giles, you will do much writing & have many fans, but for now just go play with Giles. (OMG I am squeeing in advance!)
Heh. I have the next section of "Blackmail" ready to go, coincidentally. I need to think about it a little more. Maybe tomorrow. Must push through with the Giles and the Buffy and the mumble mumble in Los Angeles...
Ooh, cool. I going to adapt the script you posted the other day to deal with the XML that my LJ client generates when it backs up a journal, but this looks like it'll get better results. Sweet.

Also, hello! I wandered in the other day from a link in elementalv's journal, and I hope you won't mind that I've friended you. I've been enjoying browsing through your fic, especially the Giles/Buffy fic. It's a newish pairing for me, and I really like the way you write them.
Hiya! *waves* Giles/Buffy is my OTP. I will wander around (Giles/Ethan is a close second, and Giles/Xander is fun, and Giles-gen-plottiness also grabs me) but that's the one I keep coming back to.

Will post the wget writeup today. I think scripts that do something like what ljdump does (grab posts using the API, save as XML) are more flexible in the end, but it depends on what people want. Do they want to inject the posts into another LJ-like system? If so, use the API. Do they want a locally-browsable archive? If so, use wget.