{"id":1443,"date":"2008-11-29T16:03:00","date_gmt":"2008-11-29T20:03:00","guid":{"rendered":"http:\/\/johncohn.org\/base\/2008\/11\/29\/friday-night-way-too-late\/"},"modified":"2008-11-29T16:03:00","modified_gmt":"2008-11-29T20:03:00","slug":"friday-night-way-too-late","status":"publish","type":"post","link":"http:\/\/johncohn.org\/base\/2008\/11\/29\/friday-night-way-too-late\/","title":{"rendered":"Friday night – way too late"},"content":{"rendered":"
\n

\t\t\t\t\t\t Yikes. I’ve been working in my lab all night and completely lost track of the time. It’s now about 2AM.. and I realized that I hadn’t blogged.  I’ve spent many hours in my lab during this break.. I realize just how much I love just tinkering in there.. If only I could make a living doing that.
 I had  a good quiet day.. not too much to report.. The four of us had a nice sushi lunch together midday.. and that was about it. <\/p>\n

It’s too late to write much more.. but I did want to report on another hacking project I took on over this break.. I wrote a simple web page extractor in Python and managed to capture all of the text of my first two years of blogging. (here’s the code if anyone is interested   )<\/p>\n

<\/small>from BeautifulSoup import BeautifulSoup
import re, urllib2
output_file = file(‘outputdata.txt’,’w’)<\/p>\n

def remove_html_tags(..
    p = re.compile(r’<.*?>‘)
    return p.sub(”, data)<\/p>\n

def remove_extra_spaces(..
    p = re.compile(r’..s+’)
    return p.sub(‘ ‘, data)<\/p>\n

def read_entry(year,month,day):
    url = “http:\/\/blog.myspace.com\/index.cfm?fuseaction=blog.view&FriendID=105120181&blogMonth=” + str(month) + “&blogDay=” + str(day) + “&blogYear=” + str(year)
   print url
    date = str(month) + “\/” + str(day) + “\/” + str(year)
    print date + ‘..n’
    output_file.write(date + ‘..n’)
   
    try:
        resp = urllib2.urlopen(url,None,100)
        output_file.write(url + ‘..n’)
        html_code = resp.read()<\/p>\n

        soup = BeautifulSoup(”.join(html_code))
             
        subject= soup.find(“p”, { “class” : “blogSubject” })
        if subject != None:
 
            subj = remove_extra_spaces(remove_html_tags(str(subject.contents1)))
            print subj + ‘..n’
            output_file.write(subj + ‘..n’)
            anyP = 0
            table = soup.findAll(“table”, { “class” : “blog” })
            allP = table0.findAll(“p”)
            for p in allP:
                anyP = 1
                cont =  remove_extra_spaces(remove_html_tags(str(p)))
                print cont + ‘..n’
                output_file.write(cont + ‘..n’)
            if anyP == 0:
                print “… Empty content..n”<\/p>\n

    except IOError, e:
        print e.reason<\/p>\n

for day in range(25, 31):
    read_entry(2006,11,day)
for day in range(1, 32):
    read_entry(2006,12,day)
for year in range(2007, 2009):
    for month in range(1, 13):
        for day in range(1, 32):
           read_entry(year,month,day)<\/i>
<\/small><\/p><\/blockquote>\n

It was fun figureing out how to do that because @$%ing MySpace doesnt’ have an export feature.. that means you can’t back up you blog.. Now I have a backup of all the text..   Just like last year, I found a program to analyze the text just for fun.. O fhte half a million words.. here’s what Wordle.com made of my blog. The bigger the word, the more frequently it was mentioned… Take a look… <\/p>\n

<\/p>\n
The more I starte a ttit.. the more I think it reallydoes sonme up the second year ….<\/p>\n

OK.. I gotta sleep now.. More tomorrow.. G’note all. G’nite Sam !
-me<\/p>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Yikes. I’ve been working in my lab all night and completely lost track of the time. It’s now about 2AM.. and I realized that I hadn’t blogged.  I’ve spent many hours in my lab during this break.. I realize just how much I love just tinkering in there.. If only I could make a living … Continue reading Friday night – way too late<\/span> →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"enabled":false},"version":2}},"categories":[1],"tags":[],"class_list":["post-1443","post","type-post","status-publish","format-standard","hentry"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"http:\/\/johncohn.org\/base\/wp-json\/wp\/v2\/posts\/1443","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/johncohn.org\/base\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/johncohn.org\/base\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/johncohn.org\/base\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/johncohn.org\/base\/wp-json\/wp\/v2\/comments?post=1443"}],"version-history":[{"count":0,"href":"http:\/\/johncohn.org\/base\/wp-json\/wp\/v2\/posts\/1443\/revisions"}],"wp:attachment":[{"href":"http:\/\/johncohn.org\/base\/wp-json\/wp\/v2\/media?parent=1443"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/johncohn.org\/base\/wp-json\/wp\/v2\/categories?post=1443"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/johncohn.org\/base\/wp-json\/wp\/v2\/tags?post=1443"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}