Another inter­est­ing day at work today. I spent another day with Dave N, just look­ing at the code really. Driven by error mes­sages and excep­tions in the log files, track­ing them down, fix­ing them where we can (excep­tions on the main­frame are soooo expens­ive). We found one error caused by a robot, TurnItIn, hit­ting the site, fail­ing to cor­rectly inter­pret or ignore some links writ­ten to the page with javas­cript (don’t ask ), and then mak­ing invalid requests as it tried to fol­low those ‘links’. Hope­fully the robots.txt fix for that one will work. Quite why turnitin is try­ing to crawl a cloth­ing cata­logue site I have no idea. No aca­demic papers here!