DragonFly and Summer of Code, week 11

Almost done with this year’s GSoC.  It’s been astonishingly… easy?  The students are working and the problems are difficult, but there’s been very little in the way of crisis.

Deduplication benefits, again

Remember my recent disk issues?  As a side effect of protecting myself, I have a good example of deduplication results.

I have a second disk in my server, with slave Hammer PFSs to match what’s on my main disk.  I hadn’t put them in fstab, so they weren’t getting mounted and updated.  I got them re-created, but they were nearly full.  Here’s an abbreviated df, from which you should be able to tell which drives I have :

Size   Used   Avail   Capacity
929G   729G   200G    78%    /slave/slavehome
929G   729G   200G    78%    /slave/slavevar
929G   729G   200G    78%    /slave/slaveusr
929G   729G   200G    78%    /slave/slaveslash

That 78% is how full the Hammer volume was.  I turned on Hammer deduplication, since it’s off by default.  The very next day:

Size   Used   Avail   Capacity
929G   612G   318G    66%    /slave/slavehome 
929G   612G   318G    66%    /slave/slavevar 
929G   612G   318G    66%    /slave/slaveusr 
929G   612G   318G    66%    /slave/slaveslash

It’s a 1 terabyte disk, and I gained more than 10% back – That’s 100g of disk space that I gained overnight.  There might be more tomorrow, given that it was all of 5 minutes of dedup work.

This won’t surprise you if you’ve seen previous deduplication links here, like my previous results or some real-world tests.  It’s still great.  I’d suggest turning it on if you haven’t – hammer viconfig the appropriate PFS and uncomment the dedup line.

 

DragonFly and Summer of Code, week 10

Only 3 more Mondays left in the student work part of Summer of Code!  Unsurprisingly, it seems the students are mostly in the cleanup phase – as it should be.

Details on dragonflybsd.org hardware

If you’re curious about the hardware being used for the colocated dragonflybsd.org servers (this includes the website, the repository, the mailing lists, dports build machines, etc.), here’s the ‘MicroCloud’ product page.  DragonFly’s model was purchased from iXsystems.   Apparently those Haswell processors have a fantastic power consumption to performance ratio.  (via)

Wanted: a Mailman patch

One of the most-requested items for the DragonFly mailing list archives is reverse sorting by date.  Mailman, which is what’s being used now for archiving, doesn’t have a ‘native’ way to do that.  Has anyone seen a trick/patch to get that to happen?  I already patch Mailman to get the message date to show in listings.

DragonFly and Summer of Code, week 8

If you look at the reports from students this week, they are mostly “I had bugs and I fixed them and there’s not much to do other than test”, which is the sign of well-planned projects.   Here’s the status reports:

Mailing list archives update note

The mailing list archives for DragonFly (lists.dragonflybsd.org) have been moved to new hardware.  (Yay!)  The patch that actually shows date in the listings needs to reapplied, cause Mailman is somewhat stale.  (Boo!)  I applied the patch and I’m regenerating all the archives now.  (Yay!)  There’s some garbled messages in the archives that cause a bunch of “no subject” partial messages to be dumped at the end.  (Boo!)  I’ll manually fix them if I can, someday.  (Yay?)