Shuttleworth on Open Source Development 162
An anonymous reader writes "Mark Shuttleworth (retired cosmonaut and Ubuntu daddy) has written an informative blog entry about the problems associated with open source development. He found that paying geeks to code without assigning them managers lead to "shiny geek toys", rather than the product he was actually paying for. Shuttleworth says that left-field thinking is required when it comes to managing open source teams. See also Andrew Orlowski's analysis of why AOL eventually killed the Netscape project from a few years ago, where he describes Mozilla developers as "wandering off into Lotus-eating land"."
Exactly... (Score:4, Insightful)
Re:Exactly... (Score:2, Informative)
Example: Why start Adept when we have YAST? (Score:2, Insightful)
YaST is the app that makes the proverbial "Linux on the Desktop" a reality. It is the most robust, comprehe
Re:Example: Why start Adept when we have YAST? (Score:2)
But still beats starting from scratch, I'd say. (especially in package management) are *sorely* behind.
And the package manager are probably the most uninteresting part of YaST anyway, it's the myriad of other tools in YaST that's interresting. Putting a nice GUI on top of URMPI or APT solves the package management part nicely, and several such already exist.
Not some huge revelation... (Score:5, Interesting)
You can have all the creativity you want - but without proper leadership, all that effort and talent goes wasted. I have a few creative friends that have all these wonderful ideas - but they have no idea on the concepts of project planning or management of resources. Needless to say, their killer applications are still brain children - and not actually out here where the rest of us can use them.
In that case self-management is the key. I've been there. Working for years in an educational environment where the actual workload was less than 20 hours, I had a lot of freedom to take things in new directions. I ended up coming up with some of my best ideas and was able to develop the discipline to implement them. But it was really hard not to get distracted. You have to develop a manager mentality--be results oriented. As a programmer / designer / creative, sometimes spending 8 hours just researching or learning something is well worth it, but at some point you have to jump in and focus hard on the final product until its done. Then you can go back into creative mode and dream up version 2.0.
Re:Not some huge revelation... (Score:3, Insightful)
Re:Exactly... (Score:1, Insightful)
it is a screaming idiot standing around keeping things in
line, or a strategic documented list of direction and goals
which are adhered-to, it is a must.
If the project lacks direction, you get what you get. No
sympathy here. I've written a lot of OS/2 apps in the
past and learned quickly how misdirection occurs without
documented direction. This isn't limited to Open Source.
At my current employer, we've hired project consulting firms
to complete syste
Re:Exactly... (Score:3, Insightful)
Re:Exactly... (Score:2, Insightful)
I think one of the reasons that technical people make such poor managers is due to inflexible thinking in many corporate environments. In every place that I've worked, I've seen managers that were quite good at managing projects (in terms of getting the people they manage to do great work that meets or exceeds expectations), but invariably that management position comes along with expanding amounts of corporate middle management stuff (reviews, HR, tracking employee hours, days off, etc., etc.) which such
I think it comes down to communication. (Score:2)
If you can get past that, then management is very simple.
The *business* has a goal of shipping product X on date Y to make profit Z.
Unstated is the requirement that it doesn't have to be perfect. Just "good enough". And, exactly, what "good enough" means in this situation.
I can ship any product on any deadline provided that there are only 2 requirements:
#1. It doesn't have to work
there ARE good leaders (Score:2)
Re:there ARE good leaders (Score:2)
Re:Exactly... (Score:1)
It's not only about creativity. You need someone who always keeps the big picture in mind. I've worked on projects where those involved get caught up in one part of the application, and get consumed by it to the detriment of the whole.
I think though that this shouldn't be seen as a condemnation of OSS, but rather as a reminder to have a clear direction and follow it. Of course, that should be a given in any project, albeit rarely a reality.
Re:Exactly... (Score:2)
> that effort and talent goes wasted.
Is it leadership or direction that's needed? Leader implies a hierarchial management structure and differentiated skill sets. But can you achieve results with the (rarer) self-directed, self-disciplined people? Is it the leader that's missing, or the discipline and vision a leader often provides?
> I have a few creative friends that have all these wonderful ideas - but they
> have no
Re:Exactly... (Score:2)
In every project, no matter what it is, whether it's open source or sending a space probe to Pluto. There will always be decisions to make that is not going to be in favor of every person on the team. Sometimes you have to cut down, cut away, change and sometimes that process can be painful. Without someone who has the final word, anarchy and a "new geeky shiny thing" is the result.
One ring to rule them all? (Score:2)
Why?
> In every project, no matter what it is, whether it's open source or sending
> a space probe to Pluto. There will always be decisions to make that is not
> going to be in favor of every person on the team.
That explains why absolutely unanimous decisions are impossible. So, we have identified one system that doesn't work; why do we need -one- leader?
Why not one-man-one-vote? Why not voting by proxy shares, given out for lines of code contributed? Why not polling the user
Human societies are hierarchical. (Score:2)
We are primates, never ever forget that, we always look to find the most suitable leader for any situation and immediately start to plot his demise. We need a silverback to protect us and to make the group of monkeys homogeneous, but we hate the silver ba
Re:Human societies are hierarchical. (Score:2)
> that it is in our nature.
It is also the nature of man to constantly strive to alter his nature.
> All this one vote rubish and all the other mumbo jumbo you mention is
> against the nature of small groups of people,
Actually, I wasn't lauding the holy nature of one-man-one-vote. I was simply pointing out that the forms under which we choose to organize can be a conscious decision. I'm not particularly enamored of voting.
Re:One ring to rule them all? (Score:2)
Knowing what you want and communicating it (Score:1)
Re:Exactly... (Score:2)
That's total BS. Shuttleworth's developers were doing exactly the right thing--according to their own objectives. They needed to get marketable technologies and software skills onto their resumes and they wanted to be on a big project, so they developed a complex, reusable, cross-platform Java solution.
These people didn't need better leadership, they needed the right kinds of incentives. Incen
Old article (Score:5, Informative)
This entry was posted on Friday, November 21st, 2003 at 6:48 pm...
A little out of touch maybe?
Re:Old article (Score:2, Funny)
Re:Old article (Score:4, Funny)
This entry was posted on Friday, November 21st, 2003 at 6:48 pm...
A little out of touch maybe?
No, no, it just took that long to be signed off by all the department heads and then approved by upper management.
I feel like I've been had (Score:2, Insightful)
Re:Old article (Score:2)
I'm not saying all 'old' articles are bad, just that in the fast-paced world of OSS a few years may be enough time for the successes of key projects (Firefox?) and companies(Google?) to infuence how such developers act and are motivated and inspired to accomplish goals.
I'm not so sure.... (Score:3, Insightful)
Re:I'm not so sure.... (Score:2, Insightful)
Yes, but the reason that its still not a "shiny geek toy", but is a grandmother-friendly tool is that someone went to the trouble of putting a proper user interface on it and testing for widespread (read: real-world) application. The article just restates a problem that many others have seen with open-source projects: the geeks create all sort of shi
Re:I'm not so sure.... (Score:2, Insightful)
Re:I'm not so sure.... (Score:2)
I agree that there needs to be a combination of new technology and user interface design. What Shuttleworth, like many others, is pointing out is that open-source development tends to produce an abundance of geek toys, but not necessarily an abundance of adequate user interfaces. It just seems to be a new take on the old "Linux won't ever popular unless a corporation gets behind it and does some UI work...
Re:I'm not so sure.... (Score:2, Funny)
Valve did that and it seemed to work out just fine for them
/ducks
Re:I'm not so sure.... (Score:2)
>The article just restates a problem that many others have seen with open-source projects: the geeks create all sort of shiny toys and efficient frameworks, but nobody actually bothers to test it for ease-of-use, or put a decent user-interface on top.
Actually, I see the problem in this case (and several others) as not so much that, as it is that if you leave geeks to their own devices, they'll work on what they want, never mind what they're supposed to. I've been guilty of this on occasion, as I'm s
Shiny Geek Toys of the Past (Score:1)
Your statement is so confident that I'm sure you have put a lot of thought into this (or you just don't have much of an imagination). I'm not arguing this way or that, but I think this is really thought provoking.
What are your favourite Shiny Geek Toys of the Past that your grandmother uses? What is Teh Ultimate Shiny Geek Toy of the Past? Could it be the wheel? Or a hammer? Toilet must be
Yes. What I want to know is... (Score:2)
Mozilla - ouch. (Score:5, Interesting)
I also agree with this:
I really hated Internet Explorer. When I heard about Mozilla, I tried Milestone 8 (around 1999), and it was slow as a snail on my poor machine. WTF were they thinking? The Netscape code might have been difficult to maintain, but what really needed a revamp was the html renderer.
The reason Firefox did get a huge market share is not because of the XUL framework, but because it was finished. I'm sure all that delay could've been avoided.
Re:Mozilla - ouch. (Score:2)
The reason Firefox did get a huge market share is not because of the XUL framework, but because it was finished. I'm sure all that delay could've been avoided.
Except that the main reason that Mozilla was so slow was because the XPCOM/XUL, not gecko. And improving tha
Re:Mozilla - ouch. (Score:2)
BTW the first major project was Gekko the HTML renderer.
Re:Mozilla - ouch. (Score:3, Interesting)
They couldn't pick QT because Netscape was not going to be GPLed and they did want Mozilla to be open source.
Re:Mozilla - ouch. (Score:2)
2) XUL is crossplatform as far as Mozilla is concerned. It may only run Mozilla, but it runs it on MSWind, Linux, and Mac (OS9 & OSX). Possibly elsewhere.
His project needs an architect (Score:2)
Re:His project needs an architect (Score:3, Insightful)
Strong architectural design definitely helps. However, it's not the be-all-to-end-all. In OSS development you have to be aware that your programmers are volunteers. They can and WILL step out the door at inopportune times, start arguements over architectural designs, and spend time working on what they think is cool rather than what is needed.
To get a project to absorb much of this chaos, you can do
Re:His project needs an architect (Score:2)
Re:His project needs an architect (Score:2)
That's what he did: he hired them, told them to produce his app which would be open-sourced, they failed to do so, and he fired them. As others have alluded to, he hired a group or (presumably) talented coders, but found that they were unable or unmotivated to organize themselves into a project development team.
Personally, I find the more interesting portion of the story to be what happened next: he wanted to ke
Re:His project needs an architect (Score:2)
Yes, it is.
I'm still waiting for a no fully functional Java runtime available for Linux so I can play it!
Maybe they need some analysts (Score:2)
I know there's a bit of a bias here on Slashdot -- and among developers in general, IMO -- against "manager types" and non-programmer software people (e.g., Analysts, Testers, Documentation Writers, etc.) but I think that one of the weaknesses of a lot of OSS projects is that they're full of nothing but coders, and very few 'ancillary people.'
I'm sure that makes for lots of code, but I'm not sure that it leads to the best final product. There's a reason why analysts and testers exist on commercial s
Who woulda thunk it? (Score:5, Insightful)
Do ya think? How long did it take him to reach that conclusion?
Seriously folks, this is a given and one of the main reasons I don't buy into all the hype about the electronic toy du jour. Everytime I see an article somewhere which says that 'X' is the latest electronic whiz toy that everyone must have I just roll my eyes and move along. (As a side note to marketers, I don't watch your commercials or read your flyers in the paper. You may now explode with unmitigated rage because I'm stealing from you for not watching what you produce.)
I don't want to be forced to buy a DVD player which plays DVDs, mpegs, connects to the net, calls my vet or offers me advice on what wine goes well with acadian rigatoni. I want the machine to play DVDs. Period.
By their very nature geeks (true geeks) will shovel every bell and whistle into a device they can get away with because that is what they do. They want to see how much cruft they can tack onto the hardware simply to see if it can be done. Top that off with manuals (the paper ones if you're lucky enough to get one) which are so poorly written and obtuse that the average user has to take lessons to learn how to program their device, and the market becomes filled with devices whose half-life is as long as the life of a fruit fly.
To all who produce this crap, here's a hint: Stop making a swiss army knife out of every product. If you absolutely must put tinsel on the tree, make three trees. The first is bare bones (i.e. just a cell phone. no music, games, etc). The second has a few more items (include games and music). The third has everything (bleeding edge). If you check your sales figures you'll be surprised to learn which one sells the best (hint: it's not number three).
Re:Who woulda thunk it? (Score:5, Insightful)
Actually, I think, you will be quite surprised to find out that it actually IS number three.
Re:Who woulda thunk it? (Score:2)
Do ya think? How long did it take him to reach that conclusion?
Well, according to the date on the article, he had reached this conclusion and spoke out about it in 2003... Ubuntu has sure come a long way since 2003. Do you think he might have learned the lesson? :-)
Re:Who woulda thunk it? (Score:2)
Look at mobile phones. Integrating a camera into the phone was a massive hit. People want integrated toys.
Re:Who woulda thunk it? (Score:3, Insightful)
Only if that device is not a true Device.
A true Device does one thing and does that one thing well; it has clearly defined inputs and does not mind what the input comes from, and it has clearly defined outputs and does not mind what the output goes to.
Then the Geek is happy, for with many such Devices and an assortment of cables the Geek can assemble a composite
Re:Who woulda thunk it? (Score:3, Insightful)
The true geek will make it as minimal as possible, stripping out features until you get down to a barebones command line interface. (That's not what grandma wants either.)
It is often marketing departments who are responsible for your DVD player offering you 'premium' or 'sponsored' content recommending particular wines.
Re:Who woulda thunk it? (Score:3, Insightful)
By their very nature geeks (true geeks) will shovel every bell and whistle into a device they can get away with because that is what they do.
I guess I'm not a "true geek" then. There's definitely a set of people that will do just that. There's also a very large amount of people that follow the mantra "Keep it simple, stupid". You really don't need to look much farther than all the extremely successfull open source software projects to know that what you're saying simply isn't true. Is Linus Torvalds not
Re:Who woulda thunk it? (Score:2)
So the most successful projects have hac4ers on the back-end driving change, with a filter on the front-end controlling what gets into the releases after careful consideration over time. Idea
Re:Who woulda thunk it? (Score:2)
Make a quality, enduring product that exactly fits the customers needs, and you'll never sell to that customer again. Crappy products make for a successful business, because crappy products keep you in contact with the customer.
Didn't you ever wonder why Microsoft rules the software world? There products have never been so poor that consumers abandon them...always just crappy enough that the users need to keep returning for the fix.
Re:Who woulda thunk it? (Score:2)
Well, I hate to break the news to you, but I worked at an electronics store when I was in college. I handled the product on a daily basis with customers, read the reports on a weekly basis and did inventory on a quarterly basis for years. Part of it was evaluating what sold and what didn't so management could pick and choose the new product mix to order (you get that job if you are the "comp
The Tao of Geek (Score:2)
That's only the yang of geek.
There are plenty of geeks out there refining their yin [sysinternals.com].
Re:Who woulda thunk it? (Score:2)
If you ever start a company, remind me to sell your stock sh
Oh noes ! (Score:1)
"So I canned the project and shutdown the development office, letting the developers go."
For Pete's sake, don't anyone let my boss see that !! O.O
Not only open source projects... (Score:4, Insightful)
Why blame OSS? (Score:5, Insightful)
Re:Why blame OSS? (Score:2)
This guy obviously hasn't been involved in many commercial software projects. Anytime there's bad leadership, odds are the product is going to fail. It doesn't matter if it's traditional commercial software, commercialy
Re:Why blame OSS? (Score:2)
Re:Why blame OSS? (Score:2)
Olde news? (Score:2, Interesting)
Seems to be a long development cycle for a specialized calendar. [schooltool.org] I'm glad I'm not paying for it.
Re:SchoolTool to be cross-platform (Score:2)
And what else did you expect? (Score:2, Insightful)
Without a reasonable framework it was inevitable the project collapsed.
The actual coding should be a minor part of a project, the real blood, sweat and tears is the spec and the architecting / design (and usability / test side of things): If that is done well enough then the coding should be a simple join the dots task.
Without architecture / design constraints then you will get toys for the boys (and girls) as there is no
Re:And what else did you expect? (Score:2)
This guy didn't really put the vision across, and didn't have a user in the process. Where we
Happy Shiney Faces (Score:2)
XUL (Score:3, Insightful)
Re:XUL (Score:1)
http://web.archive.org/web/19990508065645/www.gtk. org/announce.html [archive.org]
"""GTK+ is also being ported to Win32. For further information see: http://www.iki.fi/tml/gimp/win32/ [www.iki.fi]."""
Schooltool link (Score:2, Insightful)
http://www.schooltool.org/ [schooltool.org]
Summary of current status as I read it: SchoolTool still isn't really there, but they did manage to get the spinoff 'SchoolBell' out there, and the SchoolTool work is ongoing and being included in the 'Edubuntu' distro.
A Generic Failure (Score:5, Insightful)
It wouldn't be any more or less successful at Microsoft, IBM or SAS.
Re:A Generic Failure (Score:2)
I said something similar elsewhere in this page, but you did it more succinctly.
There's a reason why most big commercial software projects involve more than a bunch of programmer/developers sitting around and churning out code, and I think Mr Shuttleworth is catching on to why that's the case.
I've worked on projects where the number of non-programmers outnumbered actual coders by a substantial margin, and most of the actual 'design' work was not done by the programmers, it was done in the requiremen
Re:A Generic Failure (Score:2)
Re:A Generic Failure (Score:2)
Isn't that how OSS works? I don't see a spec for Linux, firefox, etc. There's no master architect that directs interfaces, it's all determined by which patch was accepted. There's no timeline to get something done, "it is done when it is done". Just check any OSS bug database, there's no
Orlowski is sooo wrong (and today we know it) (Score:2, Interesting)
Actually, Orlowski reasons for deriding the Mozilla team in "wander[ing] off into Lotus-eating land" are:
"creating esoteric frameworks". Later we learn that means "Creating a neat C++ framework when what the world really needs a non-Microsoft browser is nothing but a deriliction of duty: a piece of vanity code". Except http://weblogs.mozillazine.org/ben/archives/009698 .html/ [mozillazine.org] shows XUL creation was a direct effect of AOL pressure on advertising and netscape portal integration
"note-perfect bug tracking
30 year old philosphy... (Score:3, Insightful)
Imagine that - simple, solid advice survives time. Reminds me of the Twelve Networks Truths of RFC 1925 Section 2-11 [faqs.org]
Speaking of managers... (Score:1)
I'm not even being a troll here. Ubuntu artwork develop
Not quite (Score:2)
He paid a bunch of money for the Russians to take him up. "Retired space tourist" maybe.
He's a cosmonaut, by definition (Score:2)
Developing for Others (Score:2)
The case of the SchoolTool was that it was being
much more so for proprietary projects (Score:2)
In fact, it tends to be more a problem with closed source projects in large companies (as well as with lavishly funded open source projects). Why? Because the developers in large companies are well funded, they can go on forever doing their pet things, and upper management is often easily fooled about what's going on. The only reason Shuttleworth caught this is because he has a clue. Arguably,
Re:much more so for proprietary projects (Score:2)
You're missing the point: Sun has produced a hugely bloated platform, for the same reason that Shuttleworth's developers have--too much money, too much time on their hands, and little push to actually deliver something. The fact that desparate Java developers happen to have developed alternative
Comment removed (Score:3, Informative)
Re:You can't have it both ways (Score:2)
Are they developing for 1)themselves, 2)users, 3)clients/customers?
If you're developing for yourself, scratch your own itch, have fun.
If you're getting paid, develop what your client wants.
If you're trying to develop for users, good luck. Figuring out what they want and doing all that is a thankless task.
You need somebody who cares (Score:2)
You always get shiny geek toys. Knowing th
I spoke with the head of SchoolTool (Score:3, Informative)
The current SchoolTool is being written in Zope3 and is under tighter development control.
This is very old news and does not reflect the current understandings of either SchoolTool or Marc Shuttleworth. This article could also be called "My first babysteps in the universe of Open Source development", file under ancient history.
Kind Regards
Also Why Microsoft Is Infected With "Featuritis" (Score:2)
Certainly Microsoft is the home of "Lotus eating" when it comes to security and reliability. I mean, their antispyware product disables Norton Anti-Virus? Who thought that one up?
SchoolTool Update (Score:3, Interesting)
It is definitely tricky to manage a project with such broad and lofty goals, and we've still had our share of mis-steps and mis-directions. I have a background as a teacher and self-taught Zope hacker, so I've learned a lot of lessons about software development.
Nonetheless, a useful application is in sight. We'll have a beta this spring and serious testing in real schools in the fall of 2006. One key this time around was keeping the burn rate down and not creating specific expectations in schools and with governments that we subsequently failed to meet.
If you're interested in open source software for schools, check out http://schooltool.org./ [schooltool.org.]
Peer Review (Score:2, Insightful)
-payment to coder only when the product meets requirements
(why did anyone get paid if all you got were shiny toys!)
-select coders who can self manage
-peer review
Peer Review is very important! You could have college students doing it, as long as someone goes in there and checks that the code does what it says it should.
Was in process of moderating but removed my moderation to make this comment
Re:Peer Review (Score:2)
Now, if you want to tack a huge honkin' bonus onto a successful contract, that might provide the incentives you're looking for.
Paying geeks to code without managers (Score:3, Insightful)
The issue is more to do with programmers who can't stay on track rather than programmers who ignore the "org chart".
Zope is a good pick for this sort of thing (Score:2)
But no matter what technology and what sort of software you're building - be it OSS or not - you need a plan how to do it and should stick to that plan as far as possible. That's the lesson he learned.
I wonder if this has anything to do with The GIMP? (Score:4, Interesting)
The answer is GEGL, a non-existant "shiny geek toy". GEGL is supposed to be some amazing framework that will handle image operations the Right Way. It will make 16-bit color, CMYK, and adjustment layers appear by magic. It will be fast and generalized and light-years beyond anything Adobe has and wash your windows for you. Who knows what it is supposed to do now? Unlike the codebase of GEGL, the legend of GEGL grows by leaps and bounds.
It you read the gimp devel list archives, you'll see many cases of people saying, "I want to code CMYK", or, "I have 16 bit support". The developers always send them away, "You are doing things the Wrong Way, you must work on GEGL instead!" The result is, development is killed.
What of GEGL? Years go by and it's nothing more a "design document" aka Musings of a Lotus-Eater, that hasn't been updated since the Clinton administration. A CVS repository that goes eight months at a time between commits. No code that actually compiles and does anything. It's still just a pipe-dream shiny geek toy.
Mark Shutteworth tried to fund someone to work on GEGL. I imagine nothing ever came of it.
Re:Obviously! (Score:2)
I'm not sure there's much to disagree with in his analysis.
Re:Obviously! (Score:3, Interesting)
See how Firefox developed once it came out from under a corporate yoke. All those shiny geek toys (XUL, plugins, etc) started getting the attention they needed instead of making it work on an infinite number of badly written web pages.
Orlowski is just a hack who slags things off on the cusp of thier sucess. Hes turned The Register into a personal rant blogg, dont be suprised when it goes bankrupt.
Mark Shuttleworth on the other hand clearly states the problem, gives a lucid account of i
Re:Obviously! (Score:2)
Re:A bit old? (Score:2, Funny)
Re:different proprities (Score:2)
There are already too many software managers who think like you.(unfortunately I work for one). They value and reward quickly hacked-in features over quality engineering. It is a very short-term view. Its why Microsoft's strategy for years is now bithing them back: their products are massively bloated and full of security
Re:Faulty crystal ball (Score:2)
It's also not all that neat.
I've only delved into the Mozilla code base once, because of a weird DNS problem that ONLY happened with Mozilla... and god DAMN that was a nasty mess of spaghetti inheritance.