Friday, April 25, 2008

Lessons Learned

Yesterday I had one of the worst days at work in a long time.

Lessons learned:
  • I need to read my email more carefully. I have subscribed to so many newsletters etc. that I race through my emails and miss important points. This morning I unsubscribed from a half dozen, and will do more as time goes on.
  • I need to be quicker to ask questions or respond; procrastination caused me to a) miss an important htaccess password b) waste most of a day on the wrong approach when job requirements changed (without my input(!))
If I had emailed a sender which of two phone numbers to leave a voicemail on, I would have saved several rounds of frustrating emails (and looking really stupid) figuring out that I didn't have the right .htaccess password.

If I had questioned a surprising change in requirements up front, I could have saved a lot of pointless work (and, again, looking stupid).

Ah, me.

Labels: , , , ,

Monday, April 21, 2008

Can we trust our leaders?

Sometimes as I read U C Berkeley discussion lists (Micronet et al.) I get this Dilbert feeling that IST management is replacing older, often home-grown hand-rolled apps with corporate-style proprietary (often), cumbersome, clunky apps that create more problems (at least from the users' point of view) than they solve.

Case in point is the retirement of WebFiles. The planned replacements are "Calshare" (IST's offering of Microsoft Office SharePoint Server 2007) and bSpace, UC Berkeley's implementation of Sakai.

WebFiles costs users nothing and is platform neutral (true?). Calshare/Office SharePoint costs money and of course requires that users have Microsoft Office.

There are some things about Sakai/bSpace that are scary, and some that (I think) should have been deal-breakers when evaluating it:

File uploads are either via web form (singly, right?) or via WebDAV. But

On Apr 18, 2008, at 4:15 PM, Tom Holub wrote:
The WebDAV FAQ hasn't been updated since October 2000. The web site and mailing list archives appear to document a moribund project.
and,

On Apr 17, 2008, at 2:52 PM, Greg Small wrote (edited by steve stanley):

OK, after much testing,

It would appear that bSpace is not presently an adequate replacement
for WebFiles, although it somewhat depends on how customers are using
WebFiles.

The issues are:

1) Because of the problem creating directories with bSpace WebDav,
migration will be very tedious and time consuming. Also subsequent
use will be difficult until the problem is fixed.

2) Because bSpace WebDav only works with XP (or Vista?), Windows 2000
customers will be left out. How may WebFiles customers are using
Windows 2000 to access their files?


Here is my experience for migration of files from WebFiles to bSpace
using Windows XP SP2 with all current updates:

1) WebDav access to bSpace only works for Windows XP, not Windows
2000. I don't understand this because WebFiles seems to use WebDav
and works fine with Windows 2000.

2) Files cannot be copied directly from a WebFiles connection to a
bSpace connection.

3) Because bSpace cannot create directories with WebDav, each
directory must be created individually using the bSpace web forms
(can you count the click, scrolling, and typing actions to create a
directory tree?).

4) Once copied and made Public, bSpace seems to be an adequate
personal web server (however the effort to migrate and maintain is
much, much greater).

5) On XP with WebDav to bSpace, I am able to rename and delete files
and directories, but renaming a directory leaves an empty directory
with the old name so that the directory cannot be renamed back to its
original name. Also deleting a directory that is not empty only
partially deletes it. Type F5 to refresh and it is still there.
Renaming or deleting empty directories works.

6) On XP with WebDav to bSpace, when attempting to create a new
folder, Windows says "A folder named New Folder already exists". If
you drag and drop a folder, it says that folder exists but if you
click Yes to copy anyway it appears to create it but then reports
errors on the file copies and the directory vanishes when you refresh
the file display (F5).

7) When I copy files to a directory, Windows says that the files
exist (with 0 size) but the copy completes OK if I click "Yes" for
each file or "Yes to All".

8) The items above suggests that bSpace creates the file or folder
before copying or renaming, but fails to take this into account for
completing the operation (perhaps the WebDav operation is not atomic).

9) In bSpace, if a directory is marked Public, all files and
directories below are Public. In WebFiles, each directory or file may
be individually locked.

I guess there are always critics, but this isn't the only big technology acquisition that has that Dilbert feel to it...

-my own opinions, not those of my employer, UC Berkeley or the UC Regents...

Monday, April 14, 2008

Week 16

To do:
job description
quarterly web stats report
post pavement conference presentations
post Traffic Signal Engineering Academy page & links (done! 4/15)

Thursday, April 03, 2008

Mac Maintenance - hidden desktop files

So I'm trying to get more life out of my PowerBook G4, and I only have 6.33G of 74.41G disk space free (8.5%).

Where's all the stuff?

12:03 PM 3016 > du -k -d 1 | sort -n -r
60046424 .
53814684 ./Music
4304660 ./Desktop
1553812 ./Library
165748 ./Documents
116480 ./Pictures
54708 ./Projects
34856 ./FontExplorer X
940 ./.Trash
72 ./.razorsql
20 ./.subversion
16 ./Movies
12 ./bin
12 ./.transmission
8 ./Shared
8 ./Public
8 ./NIVdlj0508-0623.fpbf
4 ./.ssh
4 ./.config
0 ./TheVolumeSettingsFolder
0 ./Network Trash Folder

The huge amount of storage in Music I'm not surprised by, but what's that 4.3G in the Desktop folder?

12:03 PM 3017 > ls -l Desktop/
total 93536
drwxr-xr-x 11 steve steve 374 Apr 3 09:57 08-03
-rw-r--r-- 1 steve steve 779925 Mar 28 10:28 4_findings.pdf
-rw-r--r-- 1 steve steve 18585738 Mar 20 11:04 MPlayerOSX_1.0rc1.dmg
-rw-r--r-- 1 steve steve 60164 Mar 21 15:53 Picture 1.png
-rw-r--r-- 1 steve steve 68683 Mar 26 17:55 Picture 2.png
-rw-r--r-- 1 steve steve 206265 Mar 21 13:35 T2 Brief March 2008.pdf
-rw-r--r-- 1 steve steve 3469366 Mar 21 13:49 access31.pdf
-rw-r--r-- 1 steve steve 24706623 Mar 20 11:06 vlc-0.8.6e.dmg

OK, so I have 40M of disk image files. That still leaves 4G unaccounted for!

12:14 PM 3019 > ls -al Desktop/
total 93672
drwx------ 22 steve steve 748 Apr 2 08:15 .
drwxr-xr-x 3 steve steve 102 Jul 3 2005 .$$ StuffIt Temp 1120423723
drwxr-xr-x 3 steve steve 102 Nov 16 2006 .$$ StuffIt Temp 1163745308
drwxr-xr-x 3 steve steve 102 Dec 27 19:14 .$$ StuffIt Temp 1198811673
drwxr-xr-x 3 steve steve 102 Dec 27 19:19 .$$ StuffIt Temp 1198811989
drwxr-xr-x 3 steve steve 102 Dec 28 19:56 .$$ StuffIt Temp 1198900615
drwxr-xr-x 3 steve steve 102 Dec 28 19:57 .$$ StuffIt Temp 1198900637
drwxr-xr-x 3 steve steve 102 Dec 28 19:57 .$$ StuffIt Temp 1198900669
drwxr-xr-x 3 steve steve 102 Dec 28 19:58 .$$ StuffIt Temp 1198900722
drwxr-xr-x 41 steve steve 1394 Apr 3 11:30 ..
drwxr-xr-x 3 steve steve 102 Jun 26 2005 .BAHtemp-1363-1804289383
drwxr-xr-x 3 steve steve 102 Apr 28 2005 .BAHtemp-366-1804289383
-rw------- 1 steve steve 67588 Apr 3 11:44 .DS_Store
-rw-r--r-- 1 steve steve 0 Mar 17 2005 .localized
drwxr-xr-x 11 steve steve 374 Apr 3 09:57 08-03
-rw-r--r-- 1 steve steve 779925 Mar 28 10:28 4_findings.pdf
-rw-r--r-- 1 steve steve 18585738 Mar 20 11:04 MPlayerOSX_1.0rc1.dmg
-rw-r--r-- 1 steve steve 60164 Mar 21 15:53 Picture 1.png
-rw-r--r-- 1 steve steve 68683 Mar 26 17:55 Picture 2.png
-rw-r--r-- 1 steve steve 206265 Mar 21 13:35 T2 Brief March 2008.pdf
-rw-r--r-- 1 steve steve 3469366 Mar 21 13:49 access31.pdf
-rw-r--r-- 1 steve steve 24706623 Mar 20 11:06 vlc-0.8.6e.dmg

Errrk! What are these hidden StuffIt Temp directories??

12:19 PM 3022 > du -k -d 1 Desktop/ | sort -nr
4304660 Desktop/
3985408 Desktop//.$$ StuffIt Temp 1198811989
113664 Desktop//.$$ StuffIt Temp 1198811673
83616 Desktop//.BAHtemp-1363-1804289383
57680 Desktop//.BAHtemp-366-1804289383
4236 Desktop//.$$ StuffIt Temp 1198900722
4236 Desktop//.$$ StuffIt Temp 1198900669
4236 Desktop//.$$ StuffIt Temp 1198900637
2448 Desktop//08-03
1536 Desktop//.$$ StuffIt Temp 1163745308
592 Desktop//.$$ StuffIt Temp 1198900615
172 Desktop//.$$ StuffIt Temp 1120423723

12:21 PM 3024 > du -k -a Desktop/.\$\$\ StuffIt\ Temp\ 1198811989/
3985408 Desktop/.$$ StuffIt Temp 1198811989//mencoder
3985408 Desktop/.$$ StuffIt Temp 1198811989/

12:21 PM 3025 > ls -al !$*
ls -al Desktop/.\$\$\ StuffIt\ Temp\ 1198811989/*
-rw-r--r-- 1 steve steve 4081057792 Dec 27 22:04 Desktop/.$$ StuffIt Temp 1198811989/mencoder

Wow! Removing those bumps my free space up to 10.39G! (14%) Nice.

Labels: , ,

Tuesday, April 01, 2008

Web Server Stats: What to do with hax0r traffic

In my ongoing quest to produce a measure of real human use of the site, I now come to malicious traffic.

First thing: how to identify malicious traffic?

In an earlier post I describe creating Fake hacker targets like /_vti_bin/owssvr.dll (on our LAMP server). I could grep access logs for known malicious URLs like that. Problem: high maintenance. The bad guys are always discovering and trying new vulnerabilities, and I would have to somehow keep up.

I could look for large numbers of 404s per host, since probes for vulnerabilities will fail. (Well, they would if I removed the fake targets.)

Labels: , , , ,

MacBook Pro purchase decision

Yesterday I did some side-by-side comparison of:
  1. my current laptop - a PowerBook G4
  2. the possible Q3 MacBook Pro release
  3. the current MBP line

Conclusions:

worth waiting for in a Q3 (Intel Montevina platform) release:

  • (very unlikely) radically new display technology, like XO laptop - readable in direct light
  • (very unlikely) solid-state drive (SSD) as in the Air
  • (possible) hybrid SSD/HD storage
  • (possible) BluRay optical drive
  • (possible) native WiMax
  • (likely) lower power consumption
  • (likely) case redesign: lighter, slimmer, novel look

available now and unlikely to improve noticeably:

  • Penryn processor
  • 2G DDR2 SDRAM
  • 512MB Video RAM
  • 250GB HD
  • 802.11 - our friend Ann had her newish MPB here in our apartment and was able to pull in AirBears - my PowerBook can't do that.
I'm down to less than 5% free space on my PowerBook G4, so buying now is urgent, really.
The only things worth waiting for are the lower power consumption (utility) and the case redesign (vanity). I confess the last is compelling, though.

Here is a table I adapted from Apple's site. I used strong emphasis to highlight salient differences.


















































































































































My PB G4Montevina??15.4-inch: 2.4GHz
(MB133LL/A)
15.4-inch: 2.5GHz
(MB134LL/A)
17-inch: 2.5GHz
(MB166LL/A)
Display1280x854 TFT widescreen1900x1200?1440x900 TFT widescreen1440x900 TFT widescreen1680x1050
ProcessorPowerPC G4, 1.5 GHzPenryn2.4GHz Penryn2.5GHz Penryn
Memory1GB DDR SDRAMDDR3-800 ?2GB (4G max) (two SO-DIMMs) 667MHz DDR2 SDRAM (PC2-5300)
PCI Express graphicsATI Mobility Radeon 9700, 64MB?NVIDIA GeForce 8600M GT, 256MB GDDR3, dual-link DVI512MB
Hard disk drive75 GB ATAHybrid or Solid State ???200GB Serial ATA; 5400 rpm250GB Serial ATA; 5400 rpm
Slot-loading optical driveDVD±R CD-RWBlu-Ray ??8x SuperDrive (DVD±R DL/DVD±RW/CD-RW)
Expansion--One FireWire 400, one FireWire 800, three USB 2.0 ports, and ExpressCard/34 slot
Videono iSight?Built-in iSight camera, DVI, VGA (DVI to VGA adapter included)
Audio--Combined optical digital input/audio line in, combined optical digital output/audio line out, stereo speakers, microphone
Ethernet--Built-in 10/100/1000BASE-T (Gigabit)
Wireless802.11x; built-in Bluetooth + WiMax (802.16)?Built-in AirPort Extreme (802.11n); built-in Bluetooth 2.1 + EDR
Modem
-Apple USB Modem (sold separately)
Input
Air style?Full-size, illuminated keyboard with ambient light sensor; Multi-Touch trackpad
Weight
less?5.4 pounds6.8 pounds
Footprint

14.1 by 9.6 inches15.4 by 10.4 inches
Thickness
less?1.0 inch
Video accessories
-DVI to VGA adapter (other adapters sold separately)
Hardware accessories
-85W MagSafe Power Adapter, AC wall plug, power cord, lithium-polymer battery

Labels: , ,

quiet, low-power, always-available external storage

energy-efficient external hard drives:
Q: Is the power management a function of the drive itself, or of the enclosure, or of either?
Q: What is more significant: a low-power drive, or a well-managed drive? i.e., if I want quiet, low-power, always-available external storage, what am I really looking for?

A USB-powered drive would presumably be low-power, and if low-power, low-heat, so no fan, and also no power dissapation from the wall wart...

getusb.info says "bus-powered? fuggedaboudit."

Inside a desktop machine, a high-RPM drive can be (paradoxically?) more energy-efficient: it can spin up, hand off the data quickly, then go back to low-power sleep mode.

Labels: , , , ,