fixed 404s

[Mon Nov 3 11:18:58 2008] [error] [client 169.229.192.166] File does not exist: /usr/local/apache/htdocs/newsletter/01-4/2001-4.pdf
FIXED: -> 01-4.pdf

[Mon Nov 3 11:21:37 2008] [error] [client 169.229.192.166] File does not exist: /usr/local/apache/htdocs/aviation/2003/download.php
FIXED: -> /aviation2003downloads/
in /aviation/2003/index.php

also:
/aviation2000downloads/
FIXED: -> /aviation/2000/
in /aviation/2004/index.php, /aviation/2005/index.php


[Sun Nov 2 01:57:47 2008] [error] [client 169.229.192.166] File does not exist: /usr/local/apache/htdocs/sitemap/2004techtopics.pdf
[Sun Nov 2 01:57:47 2008] [error] [client 169.229.192.166] File does not exist: /usr/local/apache/htdocs/sitemap/2002techtopics.pdf
[Sun Nov 2 01:57:50 2008] [error] [client 169.229.192.166] File does not exist: /usr/local/apache/htdocs/sitemap/2006techtopics.pdf
[Sun Nov 2 01:58:17 2008] [error] [client 169.229.192.166] File does not exist: /usr/local/apache/htdocs/sitemap/1999techtopics.pdf
[Sun Nov 2 01:59:22 2008] [error] [client 169.229.192.166] File does not exist: /usr/local/apache/htdocs/sitemap/1998techtopics.pdf
[Sun Nov 2 01:59:22 2008] [error] [client 169.229.192.166] File does not exist: /usr/local/apache/htdocs/sitemap/2005techtopics.pdf
[Sun Nov 2 01:59:23 2008] [error] [client 169.229.192.166] File does not exist: /usr/local/apache/htdocs/sitemap/2001techtopics.pdf

fixed in: /sitemap/index.php

Newsletter

I also fixed a LOT of broken links in older newsletter folders (.html instead of .php, old paths that were replaced 3 or 4 years ago...)

Newsletters from late 2006 and all of 2007 didn't have index.php pages, so I copied HTML from the newsletter/archive page into new index pages for each issue in 2007. Still need to do 2006.

Finding 404s

Today I once again tail'ed the error log, and fixed a bunch of broken links to /freestuff/store.php

Then there are a lot of SSL errors...

Ooh! and I fixed some broken image links in the 2003 Summer newsletter...

Summer Newsletter

I have posted the HTML version of the Summer 2008 Newsletter.

Thanks to BBedit grep, the conversion from Word to HTML took about 4 hours for 6 articles.

But massaging the 5 images into shape took also about 4 hours, partly because I had to (re)learn the new version of Fireworks, and partly because I miscalculated the width of our main content table cell.

I first made the images 576 pixels wide, but that was 26 pixels too many, so I had to re-edit all to 550 pixels wide.

Funny thing: Caltrans has changed the URL of their DRI page sometime since 10/6 (since Google last indexed it), thus breaking all links everywhere on the web that used to point to the DRI page. So it's now wrong in the print version of the newsletter. I've corrected the URL in the web version of the newsletter, and will keep an eye on what Caltrans does next...

broken URL:
http://www.dot.ca.gov/newtech/

new URL:
http://www.dot.ca.gov/research/

On Oct 14, 2008, at 11:30 AM, Cindy Walker wrote:

Steve, Thank you for bringing this to our attention. We're working right
now to make sure both of the URLs in your email below work again, since
that's how they functioned previously.

Sincerely,

Cindy Walker
Caltrans Web Team

Mac Maintenance - hidden desktop files

So I'm trying to get more life out of my PowerBook G4, and I only have 6.33G of 74.41G disk space free (8.5%).

Where's all the stuff?

12:03 PM 3016 > du -k -d 1 | sort -n -r
60046424        .
53814684        ./Music
4304660 ./Desktop
1553812 ./Library
165748  ./Documents
116480  ./Pictures
54708   ./Projects
34856   ./FontExplorer X
940     ./.Trash
72      ./.razorsql
20      ./.subversion
16      ./Movies
12      ./bin
12      ./.transmission
8       ./Shared
8       ./Public
8       ./NIVdlj0508-0623.fpbf
4       ./.ssh
4       ./.config
0       ./TheVolumeSettingsFolder
0       ./Network Trash Folder

The huge amount of storage in Music I'm not surprised by, but what's that 4.3G in the Desktop folder?

12:03 PM 3017 > ls -l Desktop/
total 93536
drwxr-xr-x   11 steve  steve       374 Apr  3 09:57 08-03
-rw-r--r--    1 steve  steve    779925 Mar 28 10:28 4_findings.pdf
-rw-r--r--    1 steve  steve  18585738 Mar 20 11:04 MPlayerOSX_1.0rc1.dmg
-rw-r--r--    1 steve  steve     60164 Mar 21 15:53 Picture 1.png
-rw-r--r--    1 steve  steve     68683 Mar 26 17:55 Picture 2.png
-rw-r--r--    1 steve  steve    206265 Mar 21 13:35 T2 Brief March 2008.pdf
-rw-r--r--    1 steve  steve   3469366 Mar 21 13:49 access31.pdf
-rw-r--r--    1 steve  steve  24706623 Mar 20 11:06 vlc-0.8.6e.dmg

OK, so I have 40M of disk image files. That still leaves 4G unaccounted for!

12:14 PM 3019 > ls -al Desktop/
total 93672
drwx------   22 steve  steve       748 Apr  2 08:15 .
drwxr-xr-x    3 steve  steve       102 Jul  3  2005 .$$ StuffIt Temp 1120423723
drwxr-xr-x    3 steve  steve       102 Nov 16  2006 .$$ StuffIt Temp 1163745308
drwxr-xr-x    3 steve  steve       102 Dec 27 19:14 .$$ StuffIt Temp 1198811673
drwxr-xr-x    3 steve  steve       102 Dec 27 19:19 .$$ StuffIt Temp 1198811989
drwxr-xr-x    3 steve  steve       102 Dec 28 19:56 .$$ StuffIt Temp 1198900615
drwxr-xr-x    3 steve  steve       102 Dec 28 19:57 .$$ StuffIt Temp 1198900637
drwxr-xr-x    3 steve  steve       102 Dec 28 19:57 .$$ StuffIt Temp 1198900669
drwxr-xr-x    3 steve  steve       102 Dec 28 19:58 .$$ StuffIt Temp 1198900722
drwxr-xr-x   41 steve  steve      1394 Apr  3 11:30 ..
drwxr-xr-x    3 steve  steve       102 Jun 26  2005 .BAHtemp-1363-1804289383
drwxr-xr-x    3 steve  steve       102 Apr 28  2005 .BAHtemp-366-1804289383
-rw-------    1 steve  steve     67588 Apr  3 11:44 .DS_Store
-rw-r--r--    1 steve  steve         0 Mar 17  2005 .localized
drwxr-xr-x   11 steve  steve       374 Apr  3 09:57 08-03
-rw-r--r--    1 steve  steve    779925 Mar 28 10:28 4_findings.pdf
-rw-r--r--    1 steve  steve  18585738 Mar 20 11:04 MPlayerOSX_1.0rc1.dmg
-rw-r--r--    1 steve  steve     60164 Mar 21 15:53 Picture 1.png
-rw-r--r--    1 steve  steve     68683 Mar 26 17:55 Picture 2.png
-rw-r--r--    1 steve  steve    206265 Mar 21 13:35 T2 Brief March 2008.pdf
-rw-r--r--    1 steve  steve   3469366 Mar 21 13:49 access31.pdf
-rw-r--r--    1 steve  steve  24706623 Mar 20 11:06 vlc-0.8.6e.dmg

Errrk! What are these hidden StuffIt Temp directories??

12:19 PM 3022 > du -k -d 1 Desktop/ | sort -nr
4304660 Desktop/
3985408 Desktop//.$$ StuffIt Temp 1198811989
113664  Desktop//.$$ StuffIt Temp 1198811673
83616   Desktop//.BAHtemp-1363-1804289383
57680   Desktop//.BAHtemp-366-1804289383
4236    Desktop//.$$ StuffIt Temp 1198900722
4236    Desktop//.$$ StuffIt Temp 1198900669
4236    Desktop//.$$ StuffIt Temp 1198900637
2448    Desktop//08-03
1536    Desktop//.$$ StuffIt Temp 1163745308
592     Desktop//.$$ StuffIt Temp 1198900615
172     Desktop//.$$ StuffIt Temp 1120423723

12:21 PM 3024 > du -k -a Desktop/.\$\$\ StuffIt\ Temp\ 1198811989/
3985408 Desktop/.$$ StuffIt Temp 1198811989//mencoder
3985408 Desktop/.$$ StuffIt Temp 1198811989/

12:21 PM 3025 > ls -al !$*
ls -al Desktop/.\$\$\ StuffIt\ Temp\ 1198811989/*
-rw-r--r--   1 steve  steve  4081057792 Dec 27 22:04 Desktop/.$$ StuffIt Temp 1198811989/mencoder

Wow! Removing those bumps my free space up to 10.39G! (14%) Nice.

Edits Friday Feb 22, 2008

I looked through the About pages of our site today and made some changes:

Contact Us:

• Changed info about parking. (The page still said we have free parking: if visitors went by that, they could get a $40 parking ticket!)
• Cleaned up mailtos and phone number display.

Edits Jan. 22

Home Page:
added dates to Pavement Pres and Rail Safety announcements
training/:
Guide to Services no longer "New!"
contextsensitive/:
removed listing for Jan 9-10 workshop

Fake hacker targets?

Today I created the following empty files:

• /display.php
• /errors.php
• /popup_window.php

these are often requested by script kiddies (display.php thousands of times a month); now we are serving empty docs instead of returning 404 errors.

Is this an improvement?

For us, it means fewer lines in the error logs, and more useful Analog reports.

Does it cause hassle for script kiddies? Presumably their script shows them all non-404 results; will they spend a few seconds trying to figure out our empty doc? And is it dangerous to attract this kind of attention?

Update January 7, 2008:

My colleague Jon Felder says "do it," so I'm adding:

• /_vti_bin/owssvr.dll
• /_vti_bin/shtml.exe/_vti_rpc
• /_vti_inf.html
• /account.php
• /calendar.php
• /cart_content.php
• /confirmUnsubscription.php
• /errors.php
• /fax_form.php
• /freestuff/account.php
• /freestuff/cart_content.php
• /freestuff/popup_window.php
• /freestuff/squirrelcart/js/cart_content.php
• /freestuff/squirrelcart/js/popup_window.php
• /freestuff/squirrelcart/js/squirrelcart/cart_content.php
• /freestuff/squirrelcart/popup_window.php
• /freestuff/squirrelcart/squirrelcart/cart_content.php
• /MSOffice/cltreq.asp
• /newsletter/05-3/errors.php
• /newsletter/confirmUnsubscription.php
• /newsletter/errors.php
• /newsletter/newsletter.php
• /newsletter/newsletter/newsletter.php
• /popup_window.php
• /squirrelcart/cart_content.php
• /squirrelcart/popup_window.php
• /store.php
• /test.php

HAH! Take that, h4x0r!

2008 Web Projects

Givens:

1. Incremental changes to move from image-heavy to css-compliant design


2. Build web training app for CT??

Ideas:

1. improve User Interface for ACE (registration.techtransfer.berkeley.edu)
   
   
   
   1. phone-interview ACE registrants
   
   
   2. in-house?
   
   
   3. hire a contractor?
   
   
   4. virtual company?
      
      
      
      1. Find a mentor
      
      
      2. Find experts
      
      
      3. do the whole project management thing
      
      
      
      
   
   
   5. bug/pay vendor to clean up their code?
   
   
   
   


2. ditto for Squirrelcart:
   
   
   
   1. phone-interview borrowers
   
   
   2. in-house?
   
   
   3. hire a contractor?
   
   
   4. virtual company?
   
   
   5. bug/pay vendor to clean up their code?
   
   
   
   


3. build a meta-search app that returns results from ACE, Clearinghouse, Video catalog, etc.

Ok, I just removed that link.
Thanks,
Daniel

Helen Bassham wrote:
Dear Daniel & Steve - please, can we remove the link to the Intro to ITS Architecture Scholarship Program from our web site on on-line training?

http://www.techtransfer.berkeley.edu/web-based-training/

We are no longer offering this scholarship.

Fixed 404s

Besides the usual hax0r crud, I found and fixed these 404 errors:
/distancelearning/: symlink -> web-based-training
/helpdesk/: symlink -> services home page
(Hmmm... should I put in redirects instead?)

My Hard Drive

Maintenance:

Here's advice from
>Mac DevCenter, 4 years ago:

Once a month:

1. Repair the privileges.


2. Repair the drive.


3. Force the periodic maintenance.

After an application crash, a power failure or a force reboot

Immediately:

1. Repair the drive first.


2. Repair the privileges.

Then, if the computer slows down:

1. Force the periodic maintenance.


2. Update the prebinding.

Around the installation of a big new application or a system upgrade

Before, do this:

1. Repair the privileges.


2. Repair the disk.

After, do this:

If this is more than a simple OS incremental update, repair the privileges
and the file system again with the new, updated Disk Utility.

7/01/2007

System Profiler:
Volumes:
Macintosh HD:
Capacity: 74.41 GB
Available: 9.38 GB
File System: Journaled HFS+

NAV scan:
452714 files
123872 files in archives

Ran sw update (81M download)

Macintosh HD:
Capacity: 74.41 GB
Available: 9.42 GB
File System: Journaled HFS+

Huh! 40 M more available?


http://safari.peachpit.com/
Real World Mac Maintenance and Backups


11/01/2007

Disk Utility information:

Capacity : 74.4 GB (79,892,106,240 Bytes)
Free Space : 12.9 GB (13,877,231,616 Bytes)
Used : 61.5 GB (66,014,871,552 Bytes)
Number of Files : 347,112
Number of Folders : 85,270