Please create an account to participate in the Slashdot moderation system

 



Forgot your password?
typodupeerror
×
Novell Software Linux

Novell's Releases Linux Usability Testing Videos 429

sp3298622 writes "Novell is releasing primary desktop research, including over 200 videos and analysis of usability tests, at betterdesktop.openSUSE.org. Vice president of collaboration and desktop engineering for Novell, Nat Friedman: As a programmer, it's sometimes difficult to know how ordinary people with no technical experience are reacting to your software. Linux people tend to know other Linux people. In these usability tests, we selected test subjects who were experienced with Windows, but who had never heard of Linux, and asked them to perform basic tasks using the Linux desktop."
This discussion has been archived. No new comments can be posted.

Novell's Releases Linux Usability Testing Videos

Comments Filter:
  • by ettlz ( 639203 ) on Tuesday October 11, 2005 @10:19AM (#13765101) Journal
    You know that ruddy "Linux vs. Windows Usability: The Quake Installation Test" troll is lurking around here somewhere.
    • What...how hard is:
      emerge nvidia
      emerge nvidia-glx
      emerge quake
      exit; //since we were root for that /opt/idsoftware/quake/bin/quake

      See...easy...

      (please note, this is a joke)
    • So, I wanted to install Quake. I use Linux a lot. I'm no expert, but I'm pretty comfortable with it. I've heard Windows was great for people who want to play games with no hassles. I knew microsoft made it, so I pointed konqeror at microsoft.org, and away I went. Ooops. MS is a company, not an organisation. Microsoft.com! Okay, so I tried to search the website for an .iso, so I could install Windows. Nothing! I realised that it was Commercial Software. I should have known this upfront, but I'm no windows expert. So, for the privelige of *playing games,* I went down to a local computer shop and invested over a hundred dollars in a copy of Windows. (I guess there are a lot of hard core gamers who wouldn't have a problem with putting down hundreds of dollars just to play games, but it isn't something I normally do.)

      Installation was pretty smooth. I had to download nvidia binary drivers to get fully accelerated OpenGL, just like Linux. Windows is a supported platform for the drivers. I had to reboot the whole OS after installing them, because Windows won't let you easily drop back to a command line mode and just restart the GUI. No worries - I didn't have a server running on the machine, and it only takes a bit longer to reboot than to just restart a GUI.

      Caution - Windows only comes with a special limited feature browser that doesn't support tabs, or anything. It is apparently only provided so you can download the latest version of a real browser after you install Windows. Windows doesn't come with a lot of useful stuff that you expect from a Linux distro...

      So, I start reading docs to find out how you install apps on this new OS. I was having a pretty good time. Then, I learned that there is no equivalent of apt-get. If there is free software you want to download and install, you have to do it manually. So, I used the funny miniature "IE" browser to get the Quake source online.

      Ooops, bad idea. Windows doesn't come with a compiler. You can download a free version, but the full featured "Visual Studio," costs a lot of money. I didn't feel like investing the effort to understand the differences. I decided to just get binaries. Again, there is no tool to automatically download and install an app, so I had to manually google for windows binaries. Thankfully, Quake is a very popular game, so it was very fast and easy to find, but still, it is an extra layer of inconvenience.

      After a flurry of clicking "next" and eventually "finish," I finally had the game installed. Hooray. I tried to run it and I got a "BSOD." (Crash error screen) Of course, I already pointed out that Windows comes with no development tools, so it wasn't like I could try again with the debugger to see what happened. I had no way to see exactly what the issue was. What's worse, I couldn't get back to the system. This *game* had caused the equivalent of a kernel panic. It wasn't just the app that had crashed, but the whole system! this, from a system that is supposedly really great for games! It lets a game kill it!

      Okay, so I rebooted into Linux. I already knew of a website with binaries for Quake, so I went there in Konq (Which came installed by default! I didn't have to go and download it!), downloaded a package...

      dpkg -i Q

      That was all there was to it. This "Windows is great for games" garbage is just horrible propaganda.

      Now, if only I could get sound to work in Linux...
  • also check... (Score:3, Interesting)

    by tuggy ( 694581 ) on Tuesday October 11, 2005 @10:19AM (#13765104) Homepage Journal
    In addition to BetterDesktop, the <a href="http://tango-project.org/">Tango</a> Project has finally been announced!<br>
    <br>
    "The Tango Desktop Project exists to create a consistent user experience for free and Open Source software with graphical user interfaces."
  • Please proofread. (Score:5, Informative)

    by Anonymous Coward on Tuesday October 11, 2005 @10:20AM (#13765105)
    That headline is just embarassing.
  • Hm. (Score:5, Interesting)

    by Captain Scurvy ( 818996 ) on Tuesday October 11, 2005 @10:21AM (#13765114)
    Linux people tend to know other Linux people. In these usability tests, we selected test subjects who were experienced with Windows, but who had never heard of Linux, and asked them to perform basic tasks using the Linux desktop.

    Might this only result in the Linux desktop becoming more like Windows?

    • Mod parent +25. (Score:5, Insightful)

      by khasim ( 1285 ) <brandioch.conner@gmail.com> on Tuesday October 11, 2005 @10:28AM (#13765188)
      Hmmmmm .... take people who are experienced with performing a certain function on Windows ....

      Then put them in front of a different system (like say a Mac) and see if they have any problems performing that same function.

      Of course the "easiest" (and therefore the "best") user interface will be the one that is as close to 100% identical to the only one they've used before.

      That's great for Novell because they're trying to get a slice of the Windows market.

      But this does not provide ANY information that any person could not get just by spending 10 minutes on a Windows machine and copying down menu locations and order and wording.
      • Re:Mod parent +25. (Score:5, Insightful)

        by TuringTest ( 533084 ) on Tuesday October 11, 2005 @10:53AM (#13765431) Journal

        Of course the "easiest" (and therefore the "best") user interface will be the one that is as close to 100% identical to the only one they've used before.


        That's false. The best interface is one that reflects the user expectations. The Windows interface doesn't reflect user expectations in many ways, so it's possible to create a better interface than one which is just identical.

        That should be the aim for the Linux Desktop design, not just to attract former Windows users but to best serve previous Linux users as well.
        • by khasim ( 1285 ) <brandioch.conner@gmail.com> on Tuesday October 11, 2005 @11:11AM (#13765630)
          That's false. The best interface is one that reflects the user expectations. The Windows interface doesn't reflect user expectations in many ways, so it's possible to create a better interface than one which is just identical.
          Not with the testing that they're doing.

          You are correct, in theory. You are incorrect in this specific instance because their testing procedure will not yield the information necessary to find a "better" interface.

          That is because they are only testing prior Windows users.

          Those Windows users have been trained to seek certain items in certain places.

          Even if you added a button that said "Complete this test with one click", the users would NOT find it unless they could not FIRST find the Windows button/menu that they were trained to look for of if that button was in that location.
          That should be the aim for the Linux Desktop design, not just to attract former Windows users but to best serve previous Linux users as well.
          Again, I agree with that, but that will not be achievable through these tests.

          Microsoft Word used to have an option to use the WordPerfect keystrokes. This was because the people with the most experience found it very difficult to maintain their productivity while learning a new system. Even if that system was "better" for other people. Back then, the most experienced and productive people had spent years learning WordPerfect for DOS.

          Novell has learned nothing in these past years. To make it easy to migrate users, you make it an option to have an interface that is 100% identical to what they are familiar with.

          Real "usability testing" requires more people with more experience levels on different systems, including people with little or no computer experience at all.

          If you REALLY want to make the system easy to use, you have MULTIPLE options:

          # 1. Basic level. Almost no menus and lots of "I want to" included in the icon's name ("I want to send an email to someone" or "I want to look at web sites").

          # 2. Emulation level. 100% Win2K look-alike.

          # 3. Whatever other interface you design.

          The key is to build the interface to the user and what the user expects/knows.
      • Re:Mod parent +25. (Score:4, Interesting)

        by vertinox ( 846076 ) on Tuesday October 11, 2005 @01:59PM (#13767094)
        Of course the "easiest" (and therefore the "best") user interface will be the one that is as close to 100% identical to the only one they've used before.

        I would have to disagree... I do phone support for a living and help people that have only used windows computers and are not that technically literate and when I ask them to look for a folder in a list they often will look at the files and expect it the entire list to be alphabetical order like on a Mac. I have to correct them and say to look at the top of the listing for yellow folders and look for the folder name there.

        The funny thing is that these people have never used a Mac.

        Apparently for those who have never used a computer the most logical expectation is that all the files and folders are alphabetical. When I first started using OS X, I found it quite annoying since windows always had it the other way around but take a person who has used windows but never bothered to actually learn it and you'll find they'll expect something else..
    • Re:Hm. (Score:5, Insightful)

      by xtracto ( 837672 ) on Tuesday October 11, 2005 @10:31AM (#13765223) Journal
      Burn Karma!...
      Sure...
      I have seen the page and the different case studies, they seem ok but I think there were 2 or 3 cases that are a lot more common:

      1. Scan a picture, create a new document and write something about the picture.
      2. Move the pictures of your camera to the place where you save your pictures in the computer.
      3. Engage in a multimedia chat with some friend (micrphone+webcam+text)

      Of course every linux user knows [although some of they deny it] those are non trivial tasks in a linux distribution ;)

      [I can hear the shout of a thousand Linux zealot moderators :) btw I am getting linux instead of Windows in my department computer this week, so nope I am not a n anti-linux freak]
      • Re:Hm. (Score:3, Insightful)

        by orasio ( 188021 )
        1 - I don't know about Linux, but it was pretty difficult for me in mswindows, especially because the default settings didn't work, and the damn scanner button did something other than what I expected.

        2 - Ok: Step 1 : ask for the name of the software needed. Step 2 : run gtkam, and get the pictures.
        For lucky people who have USB-mass-storage cameras, and know how to use mount, it's even easier.
        As a matter of fact, I don't know how easy it is on win, because I didn't even try to do it with my own cam, it jus
    • Re:Hm. (Score:5, Insightful)

      by s20451 ( 410424 ) on Tuesday October 11, 2005 @10:31AM (#13765225) Journal
      The mark of a good user interface is that it is either intuitive (i.e., the function of particular widgets is obvious), or where this is not possible, that it is easy to learn.

      Of course the user has to start with a basic amount of computing experience. But you would expect people with windows experience to do well when switching to macs, because the mac interface is well designed, even though it is not the same as windows. So the question of whether the average windows user can figure out the linux interface is a good one.
    • by zsau ( 266209 )
      No, tho it could result in the Gnome or KDE desktops becoming more like Windows.
    • Re:Hm. (Score:5, Insightful)

      by I confirm I'm not a ( 720413 ) on Tuesday October 11, 2005 @10:39AM (#13765299) Journal

      Might this only result in the Linux desktop becoming more like Windows?

      Maybe... but...
      There was a brief comment in an article in, I think, last month's Linux Format (UK magazine) (I'm at work, so can't get at the article, sorry). Usability testing had been done on Evolution, and it was observed that one volunteer repeatedly used the "send/receive email" when they wanted to create a new email. The testers realised that the traditional "send/receive" button was not particularly intuitive. To my mind, that's the kind of useful information we might well get from this kind of testing - not assistance in turning Linux into Windows 2.

      I mention this only because I believe there's still hope ;-)

    • Indeed. I'd probably rather see it become more like OS X. Maybe they should be asking Mac users.

      -matthew
    • Re:Hm. (Score:3, Insightful)

      by TuringTest ( 533084 )
      In some ways yes, in the areas where the Windows interface makes sense.
    • Re:Hm. (Score:3, Informative)

      by databyss ( 586137 )
      I believe your answer lies here: http://www.betterdesktop.org/welcome/reports/repor t-date-time.html [betterdesktop.org]

      # Issues encountered:

      1. The date and time configuration tool is not easily discoverable from the menus, and is not listed in Personal Settings.
      2. Users assumed the root password request meant they had to log in as root.
      3. Users wanted the click behavior of the clock applet to be similar to Windows.

      # Recommendations:

      1. Fix time and date settings to not require root access.
      2. Add tim
  • So much for this (Score:5, Insightful)

    by Raelus ( 859126 ) on Tuesday October 11, 2005 @10:21AM (#13765116)
    89% sounds like a very good success ratio for the date and time test. However, RTFA and you'll see that only eleven people participated, most of them female.

    If you don't have a diverse testing population, you aren't going to produce meaningful results. The idea is fine and all, but the results are mostly useless.
    • by zyklone ( 8959 ) on Tuesday October 11, 2005 @10:24AM (#13765141) Homepage
      How many you use is not important.

      It's how they solved it, you are trying to find problems not produce useless statistics.
    • If you look at the data section, you'll see that there are over 40 users. While it does appear that the majority are female (I'm too lazy to count), it would actually *make sense* to test with more females than males, since most of the designers/coders would be male. That way they get a view point that they wouldn't ordinarily see themselves.

    • Re:So much for this (Score:5, Informative)

      by Twylite ( 234238 ) <[twylite] [at] [crypt.co.za]> on Tuesday October 11, 2005 @10:36AM (#13765278) Homepage

      The required population size depends on what you're trying to test and how carefully you select your population. If you're trying to test the failure rate of moderately experienced Windows users performing tasks on a Linux system, and you can accurately identify and select moderately experienced Windows users with no prior Linux experience, then you only need a tiny population.

      Testing the failure rate is important: 100% of 11 users succeeding at a task can give you at most ~ 90% confidence that all similar users will succeed. 1 of 11 users failing is a far stronger result, telling you that you can expect at least 9% of all users to fail.

      Various usability experts suggest that as few as 5 or 10 individuals are required for usability testing, and the remaining usability issues are discovered and resolved via the bug reporting and maintenance processes.

    • Re:So much for this (Score:5, Informative)

      by 99BottlesOfBeerInMyF ( 813746 ) on Tuesday October 11, 2005 @10:40AM (#13765313)

      89% sounds like a very good success ratio for the date and time test. However, RTFA and you'll see that only eleven people participated, most of them female.

      Eleven people is a pretty good sized group for a usability test. This sort of testing is pretty expensive and time consuming, it's not like a survey or something. From a group that size, you can get a pretty good idea of how the average person will try to accomplish a task and some problems they may encounter. I've worked on projects where usability tests included only three people to test the interface to a product costing tens or hundreds of thousands of dollars. I'm going to have to disagree that these results are meaningless. The important thing is how did the user who failed try to do the task. What stopped them? What problems did other users have?

    • by gosand ( 234100 ) on Tuesday October 11, 2005 @10:43AM (#13765348)
      89% sounds like a very good success ratio for the date and time test. However, RTFA and you'll see that only eleven people participated, most of them female.

      And we all know that programmers have no frickin idea how to satisfy a woman.

      like shooting karma-fish in a slash-barrel. :)

    • Re:So much for this (Score:4, Informative)

      by Bogtha ( 906264 ) on Tuesday October 11, 2005 @10:49AM (#13765399)

      89% sounds like a very good success ratio for the date and time test. However, RTFA and you'll see that only eleven people participated, most of them female.

      So only one of them had problems? Sounds good.

      If you don't have a diverse testing population, you aren't going to produce meaningful results. The idea is fine and all, but the results are mostly useless.

      You shouldn't let the small numbers put you off. Respected usability professionals say you only need five people for meaningful results [useit.com].

    • by frank_adrian314159 ( 469671 ) on Tuesday October 11, 2005 @10:50AM (#13765406) Homepage
      However, RTFA and you'll see that only eleven people participated, most of them female.

      Woot! And we got video of them, too!

  • Finally! (Score:5, Insightful)

    by Animats ( 122034 ) on Tuesday October 11, 2005 @10:21AM (#13765123) Homepage
    This has been needed for so long. This is how it's done.

    Developers, you don't get to check in code until you've watched the video of users struggling with your program. OK?

    • Re:Finally! (Score:4, Insightful)

      by Kidbro ( 80868 ) on Tuesday October 11, 2005 @11:35AM (#13765862)
      In all the places I've worked, it has never been the developers who have been unwilling to produce user friendly interfaces. It's usually the managers that decide that it's more important to squeeze in two half arsed features with poor user interfaces than conducting usability tests and produce one well coded feature with a good interface.
    • Umm... how will the users struggle with my program if I never check in my code?
  • this is needed (Score:4, Interesting)

    by fak3r ( 917687 ) on Tuesday October 11, 2005 @10:21AM (#13765126) Homepage
    While I've seen things like this before, I'm liking Novell's approaches to Open Source more an more these days. With the excellent SUSE 10 (still may replace Ubuntu on my main workstation) and projects like Beagle and Hula, they're set to really make a splash if they take this useability idea seriously. They seem to be gelling more on the desktop than anyone else of late, 3 years ago who'd have expected Novell to be doing this? Awesome.
  • opensuse.org? (Score:3, Interesting)

    by Dogers ( 446369 ) on Tuesday October 11, 2005 @10:23AM (#13765133)
    ..including over 200 videos and analysis of usability tests, at betterdesktop.openSUSE.org.


    That's funny, that url points to betterdesktop.org.. Is this subliminal advertising now? o_O
  • by rob_squared ( 821479 ) <rob@rob - s q u a red.com> on Tuesday October 11, 2005 @10:23AM (#13765135)
    200 videos + slashdot link = massive conflagration.
  • Fortitude (Score:5, Insightful)

    by minginqunt ( 225413 ) on Tuesday October 11, 2005 @10:24AM (#13765138) Homepage Journal
    It's a hard thing is to admit that free software has a usability problem. The natural temptation is to sit and watch these videos whilst screaming "You idiots! You don't click "Send and Receive" if you want to send an email! What's wrong with you?!?!"

    It is difficult, but it's vitally important. These people aren't stupid losers- they are fluent in another operating system, where they can achieve whatever it is they want.

    The problems on show here are ours, not theirs.

    Martin
    • Re:Fortitude (Score:3, Insightful)

      by rhsanborn ( 773855 )
      Well said. Now if all geeks understood that not all people dedicated countless hours to learn new systems and therefore aren't able to install an nVidia card in less than 3 hours on Linux, then we might be able to encourage less technical people to switch to a more technical OS. Hopefully, we can do it without ruining the OS though.
      • Re:Fortitude (Score:3, Insightful)

        by meringuoid ( 568297 )
        Now if all geeks understood that not all people dedicated countless hours to learn new systems and therefore aren't able to install an nVidia card in less than 3 hours on Linux, then we might be able to encourage less technical people to switch to a more technical OS.

        Less technical people don't install nvidia cards. Less technical people use whatever came with their computer. And anyway, nvidia have done a quite stellar job with their Linux drivers - the only objections I have are ideological. The procedu

    • by khasim ( 1285 ) <brandioch.conner@gmail.com> on Tuesday October 11, 2005 @10:41AM (#13765324)
      It's a hard thing is to admit that free software has a usability problem.
      No it's not. It's just difficult to accept that Windows is the best user interface. Particularly because the Windows user interface seems to be changing with every release now. Using that logic, the GUI would never have been accepted because everyone at the time was far more familiar and proficient with the old DOS system.

      I have users who were quite skilled with Win2K who are lost with WinXP (until I show them how to make it look like Win2K).

      So, which interface should Linux emulate then? Win2K or WinXP? Or Mac? Or something else?
      It is difficult, but it's vitally important.
      It is difficult and it is important ... but this approach is wrong.

      This approach will give you completely different answers depending upon whether the group you select is familiar with:
      a. Win2K
        or
      b. WinXP
        or
      c. Macs
      These people aren't stupid losers- they are fluent in another operating system, where they can achieve whatever it is they want.
      Yep. And so the "best" interface for Linux would be ... whatever the majority of Windows users are familiar with.

      Novell could have saved all that time and money and just spent 10 minutes with a Windows machine, copying down menu locations, order and wording.

      There is NO "usability testing" being performed here. No one will learn whether a specific Windows implementation of a menu is less optimal than a different one.

      All that will be "learned" is whether those users can find the Linux equivalent and that will always be easiest for them when the Linux menues are 100% identical to the Windows menues that those users are familiar with.
      • Yes but ... (Score:3, Interesting)

        by shis-ka-bob ( 595298 )
        It certainly does look like the solutions are 'do it like Windows.' Look at the report on setting the clock [betterdesktop.org]. They recommend allowing non-root users to be able to reset the clock and that the process resemple Windows. I say this is all wrong.

        First, I don't want users to mess with system settings unless they are allowed to (e.g. unless they are admins in 'wheel'). I'm happy to support regular users, but not regular users that think they should be adminitering a system they don't understand. I'm not try

        • Re:Yes but ... (Score:3, Interesting)

          by Beatbyte ( 163694 )
          Why not have a per user clock that has nothing to do with the hardware clock or the system clock?

          Tell the person to choose a time zone and NTP does the rest. You could have this for every user on the system if you want.

          Either way, a DESKTOP/WORKSTATION situation has issues such as this which normally you can change (see: all other operating systems)
      • It's just difficult to accept that Windows is the best user interface. Particularly because the Windows user interface seems to be changing with every release now.

        Not sure I follow you. Are you saying flat out "Windows has the best user interface"?

        Because I call bull.

        The best user interface is the one that your user can use easily and be most productive in. Sure, for some that will be Windows. For some, Macs. For some, Linux. Heck, I was rather fond of RISC OS.

        IME, the great majority of Windows users a
    • The problems on show here are ours, not theirs.

      While I do agree a bit with this, we do need to keep in mind that it is a completely different Operating System which is not the one they are use to using. I think you'd see similar results if you take a person that has only used Windows and put them on a Mac, or vise versa.

      What we need is people that are well trained on all Operating Systems and be able to compare them without zealotry or bias. We know that MS or Apple won't change their OS layout unless 3 mil
    • Re:Fortitude (Score:3, Insightful)

      by value_added ( 719364 )
      These people aren't stupid losers- they are fluent in another operating system, where they can achieve whatever it is they want ... The problems on show here are ours, not theirs.

      I have always had the greatest patience for someone starting off learning something, but I'd suggest that the users you're referring too are indeed stupid, and that your use of the term "fluent" is confusing the issue. The average Windows user is fluent only to the degree they have learned to recognise certain icons (on their desk
    • Re:Fortitude (Score:3, Insightful)

      by Tom ( 822 )
      These people aren't stupid losers- they are fluent in another operating system, where they can achieve whatever it is they want.

      So because they are fluent in english, we should do away with french even though it creates the better poems?

      Sorry, blindly copying is not improvement. Intelligent copying is not doing everything the same way. Take what works, leave the rest. And the definition of "works" is not "what people are used to". A lot, a huge amount of the things that "work" on windos are actually cludges
  • Did these tasks involve things like opening a word document and writing in it? Or did they involve things like adding a new printer, or sharing files over a network. Oh, and what about installing? The site didn't seem to say exactly what parts of Linux they were testing.

    For the former, both Windows and Linux are equally simple, because it's a simple task. For the latter type of task, Linux is substantially more complicated than Windows, but for Joe Bloggs it doesn't really matter much because they hav

    • Did these tasks involve things like opening a word document and writing in it? Or did they involve things like adding a new printer, or sharing files over a network. Oh, and what about installing? The site didn't seem to say exactly what parts of Linux they were testing. For the former, both Windows and Linux are equally simple, because it's a simple task. For the latter type of task, Linux is substantially more complicated than Windows

      Eh... to open, and write into, a word processor: yep, both just as eas


    • Those are very interesting questions. If only there were an article somewhere that answered them.

      Of course, what would be really great would be if some people would not just assume certain tasks were "simple" and move on, but actually watch some real live users try to acomplish them. They could even videotape it to see exactly what the stumbling blocks were. Then someone could write an article about it so others would understand what they assumed was simple actually causes problems for people. Of course
  • by HerculesMO ( 693085 ) on Tuesday October 11, 2005 @10:25AM (#13765162)
    but another entirely to start working on a solution. The barrier to desktop Linux lies in simplicity, and without conducting a study or showing you a video, I can explain it easily.

    Go to the web on a Linux PC (provided you've got a browser pre-installed), and download a tarball of say, Firefox. You are a Windows user but you're 'elite', so you use Firefox, and since it's available for Linux, you want to have the same browser.

    You have downloaded the tarball, presumably to your desktop. You double click on the file, and it gets opened by Archive Manager. And from here, you can bet that 99% of the Windows folks that would like an alternative to their PCs will not make the adaptation to Linux.

    It has to be EASY. Apple set the benchmark for this -- and if imitation is the greatest form of flattery, then do it. Who cares about inflating Apple's ego? If Linux makes a breakthru on the desktop because it's as easy to use as an Apple, or even as easy as Windows, how does that hurt anybody? The true geek can rely on the the commandline only distros, or drop to terminal to get their tasks done using regular expressions and grep or whatever they want, while the 'idiots' (and I would venture to say, that I'm one of them) can use the nice GUI that's simple to follow and easy to use.

    Then folks, when developers see that they can cross develop applications that work in Linux (with little overhead), and that people will be able to easily use and access them -- THEY WILL. The open source community just needs to see that fact and start making solutions happen. With the extremely fast and accurate nature of Open Source, the feats that have come from it are amazing. It's more amazing, that the basis of Open Source -- Linux -- remains fundamentally unchanged to accomodate the eager Windows users (read: ME) to switch fully to Linux. Until the snobbery stops and changes start, Linux on the desktop is going nowhere fast. And that's upsetting for a Windows user tired of his OS, and not wanting to get tied into another corporate entity (Apple).
    • Actually, it is FAR more likely to be this easy under Linux. All the tools are gratis. None of it is shareware/crippleware. You can always depend on at least tar/unzip being available if not the KDE or Gnome equivalents of winzip. Contrast this with Windows where the tools are not at all standardized or standard.

      I mean really, pullleeeze. Installing winzip or somesuch is something that I nearly always have to do when getting my hands onto ANY WinDOS machine for the f
      • Because I'd like to start using Linux in the GUI form first and figure out the intricacies later thru use of the terminal and command line.

        The GUI form however, is still difficult to use for the average Windows user (me). Fix that, and you have another convert to preach the word :)
  • Missing... (Score:5, Funny)

    by TerminaMorte ( 729622 ) on Tuesday October 11, 2005 @10:26AM (#13765167) Homepage
    Missing Tests:

    1) Ooops! Find your kernels source, kill X, and install the drivers for your video card. Oh, and updated XF86Config. Or Xorg.conf. Whichever one you happen to have.
    2) Damnit, another kernel panic. Find what obscure change caused it to happen this time!
    3) Ah, so now you have a wireless card? Try to get it working! You might need to use ndiswrapper. If you get another kernel panic, go back to #2.
    4) Ah, can't get above 800x600 resolution, eh? Yeah... find your monitors horizontal and verticle refresh rates. Google it, and you might get lucky.
    5) Figure out how to resolve RPM dependancies. Shit, that package needs Python 2.4.2, huh? Ah well, 2.3.9 is installed. Guess you're out of luck.

    All joking aside, this was a pretty intresting study. ;)
    • It's great to see ONE distro maker starting to think along these lines, we may have a useable-by-the-masses distro one day yet!

      My brain couldn't help but spit out additional steps to the ones you listed just like a stock ticker during the crash of 1929: .....and load some kernel modules to make your nonstandard usb device work (you did remember to stop in middle of install and build/load extra driver disk). Add video resolution setting to grub menu line so boot won't hang. Chnage permission of device f
    • Re:Missing... (Score:4, Insightful)

      by MobyDisk ( 75490 ) on Tuesday October 11, 2005 @11:35AM (#13765865) Homepage
      The parent post was written to be funny, but it is actually very insightful. This biggest problem for Linux isn't where the menus are located, or how the icons look, or the confusion over the meaning of the "Send/Receive" button. Those things happen on all operating systems and all software. The users eventually figure it out. But Linux isn't even ready for that stage yet.

      Linux needs to work on getting software and hardware to work together reliably. That means without having to edit configuration files and without going to a command prompt. Simple basic things are missing. We need to work on drivers, resolving dependencies properly, and making packages that just work (including installing icons and adding documentation).

      After we get that stuff resolved, then tweaking the UI will become more relevant.
  • by hazee ( 728152 )
    For pity sake. I'm not normally a grammar nazi, but editors, please, could you not at least make sure that ARTICLE HEADLINES are at least written in some semblance of English? Or is that too much to ask? Sheesh...
    • by bjtuna ( 70129 ) <<brian> <at> <intercarve.net>> on Tuesday October 11, 2005 @10:31AM (#13765224) Homepage
      I usually *am* a grammer nazi so this shit bugs me. I think the Slashdot editors need to put this poster on their walls:

      http://angryflower.com/aposter3.jpg [angryflower.com]

    • "I'm not normally a grammar nazi"

      Obviously!!
    • by Zwack ( 27039 ) on Tuesday October 11, 2005 @10:49AM (#13765394) Homepage Journal
      But it ALREADY is in a semblance of English... I mean it looks like English, I can understand every word...

      I just can't parse it.

      "Novell's Releases Linux Usability Testing Videos"

      Let's take it a word at a time.

      Novell's Ah, it's got an apostrophe s on the end, so it's either possesive or contractive. As Novell is an entity I'm assuming that we're talking possessive here. Something belonging to Novell. Good start...

      Releases. Well, this can't be a verb as we're expecting the noun that is possessed by Novell, so while it might be nice to think that "Novell Releases" is the start of the sentence, instead we're looking at somethings (it's plural) that Novell owns. So Novell's Releases. Some items owned by Novell that have been released. Excellent, now what about these mythic Releases...

      Linux... This isn't so good. Linux is a noun, and not a verb... Three nouns in a row? It's probably not unheard of, but in this case I'm expecting a verb. I want to know what Novell's Releases do... Well, let's soldier on and see if the verb appears later... Perhaps Yoda wrote this.

      Usability... Nope...

      Testing... Hmmm, perhaps test is being used as a verb and the entire portion in front is being used as a compound noun as favoured by Germans...

      Videos. Yes, that's it....

      The "Releases-Linux-Usability" (whatever that is) owned by Novell is testing Videos!!! Are they testing VCRs? Video Codecs? Movies? Perhaps if I read the article it would tell me.

      Or perhaps they REALLY meant "Novell Releases Linux Usability Testing Videos" NAAAAH!

      Z.
      • by maxwell demon ( 590494 ) on Tuesday October 11, 2005 @11:50AM (#13765998) Journal
        Well, you need to add to your grammar rules the following: There is no noun which cannot be verbed.
        If you apply that rule to Linux, then it's clear:
        • Novell's Releases: well, you already correctly parsed that at the beginning of your post.
        • Linux: That's now the verb.
        • Usability Testing Videos: Those are obviously videos related to usability testing.

        Ok, now we just have to find out what it means to linux a video ...
      • You remind me of a bad compiler.. I miss a semicolon and it spits out a page of unrelated errors.. :)
  • by ShatteredDream ( 636520 ) on Tuesday October 11, 2005 @10:28AM (#13765191) Homepage
    Prior to Windows XP, Windows did so well with the average user because it was "good enough." It wasn't technically the best, in fact 9X was technically inferior in many areas to even Linux circa 1995-1997. So here's the problem. If Linux cannot meet or exceed Windows in every area that matters to a user, why switch to Linux instead of staying with Windows or going to MacOS X? I have a Mac Mini, it could end up being a major threat to desktop Linux for the people out there who are less concerned with having all of their options open and more concerned with getting a system that is cheap, small and just works. If you're not going to use all of the resources available on a new system, why spend $800 for a new Dell system when you can pay $500 for Mac Mini? For the average user there is no reason to pay the extra $300 if they get the software they need.

    Desktop Linux needs to grow up in a hurry. That means it needs to be as easy for the average user to use as Windows XP is by the time Vista comes out. I've used a beta of Vista and was incredibly impressed... and I'm a Mac fan first and foremost. Vista is a major threat to Linux and will solidify Microsoft's control, not end it, if things don't change.
    • People tend to think differently when they are paying the licensing fees for all the copies of Windows they will need to replace.

      I know I'll hang on to my XP Pro box for a while before I rush off and go to a Vista based system, even with all the eyecandy and new features.
  • The results are in (Score:2, Interesting)

    by pmike_bauer ( 763028 )
    10,000 /doters render http://betterdesktop.ximian.com/video/ [ximian.com] unusable.
  • by Waffle Iron ( 339739 ) on Tuesday October 11, 2005 @10:37AM (#13765282)
    It's obvious that Linux has user interface problems that are holding it back on the desktop. For example, most apps take '-x' style options. However, confusingly, many apps have now added '--foo' options.

    What's worse, some frequently used apps don't conform to any options standards at all. 'ps' takes a confusing mixture of options, some with dashes and some without, which are mutually incompatible. 'tar' needs some options without dashes, and some with. 'dd' uses a totally different keyword-based scheme like 'foo=bar'. And 'find' has its own little expression language on the command line.

    Clearly, grandma isn't going to be able to use Linux until all of these confusing option schemes are made more consistent.

  • We've secretly replace their regular Windows desktop with Linux. Let's see what they think...

    Sounds like an elaborate advertisement, eh?

    -matthew
  • by famebait ( 450028 ) on Tuesday October 11, 2005 @10:45AM (#13765359)
    As a programmer, it's sometimes difficult to know how ordinary people with no technical experience are reacting to your software.

    How about "always completly fscking impossible" for more precision.

    Not that there's nothing to gain from training and experience in usability design. Far from it: it will let you skip many obvious problems, and help you resolve others that users find for you in better and more efficient ways. But until your interface is tested on "real people" in at least a couple of iterations, there is no way in hell you can call it "good", "finished", or anything of the sort. If you don't agree, you've probably never done any real usability trials. There are always surprises. Often really big ones.

    Your fine tuned detail somewhere may work just as plannned, but it will easily be swamped by problems stemming from inadvertent signals the interface is sending which never occurred to you, or from assumptions you never questioned or even spotted, which utlim ately make people (rightfully!) misunderstand the whole metaphor and do the wrong thing.

    There are good news though: If you are willing to really really accept that the user is right (the way people percieve your product is in fact the way they perceive it, and you won't be around to explain to them that their thinking is wrong), and have set aside reasonable time to correct the problems you will find, - usability trials are fun!

    Seriously. Fun, enlightening, and humbling (but in feelgood way), and they will broaden your horizons by illustrating just how differently from your daily assumptions it is not just possible but common to think. Do them. You'll like it.

    Just resist the urge to explain the problem to the subject (except to be able to move on to test other things). Write down the problem in stead. The trial is for your instruction, not theirs.
  • Flash abuse (Score:4, Interesting)

    by sfraggle ( 212671 ) on Tuesday October 11, 2005 @10:47AM (#13765385) Homepage
    Has anyone seen what they've done with flash on that site? Their titles are all individual flash applets just displaying some text in a fancy (but ugly) font. For a Linux site this is rather appalling.
  • by Anonymous Coward on Tuesday October 11, 2005 @11:04AM (#13765543)
    The problem is not the contributions. The problem is getting those contributions accepted by the maintainers.

    Over the years I realized that the request of contributions is just a poor excuse to avoid conversations with the developers or users who want something to get changed.

    Some stuff in gnome-vfs for example was so utterly broken that it wasn't touched for a really long time. There wasn't even a maintainer for it (only a guy who kept putting some stuff in there whenever it was needed). Now some other people seem to have taken over the maintainance of it and the process continues.

    But within the GNOME development team I found out (due to own experience) that it's quite difficult if not highly impossible to get some ideas through or to convince a developer that a different approach would have been wiser or better. Not to say save a lot of time. But people kept using the broken components for years.

    Even now not everything inside GNOME is sane or reliable and a lot of stuff seem to be reinvented over and over again. See DBUS for example or basic things like "specifications" as found on freedesktop.org. GNOME makes freedesktop.org sound like it's a place for developers from GNOME and KDE to met and declare specifications but this is not always true since KDE had solved most of the necessary things that GNOME still urgently needs years before and their specifications and solutions are often by far better thought through and much more mature - and over the years proven that it also works practically and not just as concept.

    For example you can compile KDE with a static prefix in say /opt/kde3 and later on you can move this entire directory to /usr/local/kde3 without the need to recompile anything. On GNOME we sill have the issue that every path is hardcoded inside the binaries so you can't move the entire location if necessary. One of the bad concepts of GNOME.

    Another bad thing about GNOME is that the developers do have nice ideas at time but they lack the power or durability to make the changes or visions they have complete. GStreamer for example is indeed a nice technology and it somehow made it's path inside GNOME but still it doesn't feel like it's truly part of GNOME since some apps use it, others avoid using it and stick to xine. Now if these apps stick to xine then chances that GStreamer gets fixed and a whole part of GNOME is low.

    Another thing is that plenty of the developers seem to have rotating focus on stuff. Today they work on this one, then tomorrow they focus on hacking on Mozilla or hack on 'dead ideas' they have that no one really takes serious so all the resources of working and fixing GNOME get's lost with playground stuff.

    We all know that GNOME was meant to be a corporate desktop. But then a corporate desktop needs different resources and a different approach. Serious project leading is required, strict guidelines are required, and people with brains to enable them.

    It can not be (now that the HIG as guideline exists for some years) that applications developer still ignore it. I don't care for third party stuff. But I do care for the important and key elements of GNOME software that should be a good example and follow these guidelines.

    GIMP, DIA, Evolution, Abiword, Gnumeric only to name a few are in no way HIG conform. Some are, but others not. I filled in a bug for Gnumeric not long ago pointing the developer to the HIG v2.0 where it says that the Toolbar should obey the rules of Toolbar & Menus capplet (which is a core part of GNOME) unfortunately the bug was closed as not a bug and no further comments have been given to it.

    Also printing is a necessary importand thing in GNOME imo and it can't be that I load up GThumb to print a *.gif file and it ends up in printing a totally black picture on a white sheet of paper, wasting nearly 1/3 of my black ink cartridge.

    It's also inacceptable for a corporate desktop to have a document reader and viewer like Evince that prints a whol
  • the driver hurdle (Score:5, Insightful)

    by mcraig ( 757818 ) on Tuesday October 11, 2005 @11:10AM (#13765617)
    Personally I think the hardest task for an average user to perform on linux at the moment is driver installation, and lets face it for most people getting all their hardware working is the first step towards adopting a new system. I recently tried installing drivers for my ATi Radeon 9800 Pro a pretty mainstream card from a well known manufacturer, needless to say it's not straight forward by any stretch of the imagination. You simply can't expect joe public to ever learn how to compile his kernel and even messing around with kernel modules is probably asking too much.

    Linux is certainly making progress synaptic does a great job of alleviating dependency hell and almost entirely masking it from the end user. I'd like to see the linux community not necessarily looking to emulate the functionality in Windows or Mac OS X but instead looking for what would be the most elegant solution. Perhaps something like an online database of drivers that manufacturers could update, which could be automatically 'pushed' onto your computer overnight and silently rebooted (with your permission in a preferences box) so that you don't even have to worry about having the latest drivers it all becomes automatic would be neat, in the event it failed to reboot it could roll back to the previous driver and notify you in the morning of its attempt.

    You could allow users to rate drivers and add the ratings to the database, this way you could specify you only want to automatically update to new drivers that are rated 3/5 or higher for example. This could be like linux's answer to Windows update only better.
  • Tainted Sample (Score:3, Insightful)

    by Tom ( 822 ) on Tuesday October 11, 2005 @11:10AM (#13765619) Homepage Journal
    Why use people who have experience with windos? It doesn't take a study to realize that they will be trying things - surprise - the way the are used to doing them, i.e. the windos way. As a result, everywhere the choosen Linux UI differs from windos will show up as a "usability issue" when in fact it's not.

    Putting people with no computer experience there would be much more enlightening, especially when it comes to finding what things are intuitive and which aren't.

  • by 10Ghz ( 453478 ) on Tuesday October 11, 2005 @11:17AM (#13765683)
    For example, we ran comparison tests on KDM and GDM to figure out which program was more usable for members of our target audience.


    Sounds interesting! But I can't find any data regarding that comparison. Sure, there are tests about logging in, but no data about comparing KDM and GDM.

    Here you will find over 200 videos of people using Mozilla Firefox, Evolution, Open Office, Banshee, F-Spot and other applications.


    3 Gnome-apps, 2 neutral apps. Where's KDE-apps? Looking at the data-section, I see this:

    A test that deals with changing the background can involved things like Nautilus or GNOME Control Center


    Again: Where's KDE? Going thropugh the test data I see that every single test was with Gnome. Where's KDE? So instead of being called "Better Desktop", maybe this should be called "Better Gnome" instead? then again, what can we expect from having a Gnome-guy running the show? So much for equal handling of the desktops....
  • It's No Less True (Score:5, Insightful)

    by aarmenaa ( 712174 ) on Tuesday October 11, 2005 @11:28AM (#13765801) Journal
    I should start by saying that I use Windows on my primary desktop. For a while, I really tried to switch to Linux - Unbuntu, Mandrake, Slackware, and Fedora have all been on my box at one time or another. For the most part, getting the OS installed isn't rocket science. What is difficult is working around all the crap once you get a Linux distro installed.

    Getting the desktop to look like anything except blurry ass requires an hour of reading about how to install your video drivers. Why? Because after installing your package using the really nice script, it still doesn't work. So you google again and figure out you need to edit that ghastly xorg.conf file. And then Google to figure out why the resolution is stuck. And then Googling again to figure out why the refresh is stuck at 54 Hz and giving you a massive headache. Dual monitors? TV out? You may as well just go cry yourself to sleep unless you're an uber-leet nerd, because that stuff takes hours to set up. That shit is a matter of one click in Windows; my mother can do it.

    Then there's networking. Support for your wireless adapter may or may not even exist. If it does, it's probably in one of the generic Prism2 drivers or something like that. Great, but it doesn't help me a whole damn lot - mine says Netgear on the front. Back to Google again. It's also intresting to note that Linux's DHCP client and the server in my Linksys didn't get along real well, even on a wired connection. There's no way someone who doesn't know how that crap works would be able to troubleshoot that.

    Of course, there's always multimedia playback, right? The install I liked best so far, Unbuntu, couldn't play anything out of the box. I know it should have been able to, but for whatever reason my install was futzed no matter how many times I reinstalled it. I never could figure out how to make it play videos. There were several settings for decoding and such (as well as about 10 different players to choose from), but nothing seemed to change no matter how I tinkered with those settings. Oh, and Unbuntu comes with several options for audio input and output including ALSA and ESD. WTF is the difference? I've heard of ALSA before so I'll use that one. Oh wait, that one doesn't work, but the ESD one does. Well, as long as I hear sound I don't really care. At this point, I don't even want to Google it.

    This is why there aren't more Linux desktops: there are severe usability issues. I find it easier to get a webserver complete with PHP and MySQL up and running on Linux than a desktop. Why? Because I don't need video drivers, audio, or wireless networking. I also don't change my server hardware every month or two. Linux makes a great server, for sure. But as great a server as it is, it's a shitty desktop. And you'll please excuse my anger, I just got finished configuring my Linux install and promptly broke it...again.

    Here's what desktop distros should be working on:
    • -When it says it's installed, it'd better work (video drivers)
    • -Drop the funny names. Yes it's superficial and shouldn't matter, but it does.
    • -Make the defaults work. If the driver's there, the comptuer should play sound. And it should always be able to play video out of the box. And at least try to support the mouse wheel. I use mine a lot, and they come on every modern mouse. Why do I need to Google to figure out how to make it work in Linux?
    • -Where possible, make it one click. Things like multiple displays shouldn't be so hard. Things like resolution and color depth should be changeable in an applet, not a config file.
    • If a luser asks how to do something and your response is to call them a retard and tell to open up a terminal, your software's fucked. Lusers don't ask hard questions, which means that what they're asking for is a fundamental basic. And you just buried it under a shitload of command line.
    • by mrsev ( 664367 )
      Many I be the first to agree with you. I want in my heart of hearts to be able to install Linux on my fathers computer. This is to save myself hours of tech support over the phone with his various spyware/malware/networking/foo issues with Windows.

      The problem is I want my father to be able to configure and install things. For him to do that he needs a system that works. When he buys a new camera or scanner or webcam he wants a single app on a CD or website that he can download and clik and automagic it work
  • If we mimic Windows XP people will be lost when they are used to Windows Vista etc. I sure agree that care needs to be taken to make things simple but it dont think cloning Windows is the answer. Making a copy of somthing that hard to use is wasted. I am a network admin and i see the difficulties people have with Windows everyday. Windows XP totally blows their world apart since they are used to Windows 98. Same thing will happen with Windows Vista.

    The solution would be to think long and hard about whats the best way to do things and then stick to it since change seems to be the biggest problem. Just dont change to much and try to KISS.

    There arent that many parts i feel must be changed in Linux. For mass adoption a common third party package format for Linux applications would probably do the trick. Make it easy to install applications and drivers that arent managed by the dists repos. Other than that i really cant think of something thats hard to do on Linux.
  • by Bork ( 115412 ) on Tuesday October 11, 2005 @12:42PM (#13766443) Homepage
    You can not design something without the average user being part of the process.

    Where I use to work the software development people sometimes were not engaged in what was happening on a manufacturing side. They "developers" thought they new how to do the manufacturing technician job but it was of those, "I think I understand what I thought you said".

    They would start a job trying to get a specification together and so the people they would talk to were the managers of the manufacturing technician. Well guess what - they did not really know the job ether and what was ended up being developed would drive the technician up the wall with how things in there words was "screwed up".

    What happened on latest projects was before getting to far into the project spec, they also included the technician in the interviews. Then once a somewhat rough spec was put together and some idea of the direction it was going. The next step was to videotape the technician doing the job as it was currently being down. One month was spent on just taping various people doing various aspects of the job. Each taping session went through a post-mortem review with all parties involved, the spec writer, the software developers, the managers, the technician, and anyone else they could drag into the meeting. The tape would be gone through and question like "Why did you do that? That's not written down anywhere" would be said every five minutes. Even the managers were asking what was going on.

    What was brought out in all of this is that unless you are actually doing the day-to-day job in manufacturing, you do not understand the process no matter how many design meetings you have with them. This became the standard method on following projects.
  • Finally (Score:3, Informative)

    by fsterman ( 519061 ) on Tuesday October 11, 2005 @01:44PM (#13766957) Homepage
    Hopefully this is a general trend for the industry. Maybe everyone will start using these techniques that have been available since the early 70's. Maybe instead of designing from the seat of the their pants they will start testing their interfaces just like we do with all software.

    This isn't hard. Usability labs like this aren't necessary. I only have to sit any member of my immediate family down, my parents friends, co-workers, etc. to get an idea. Maybe more serious testing needs specialised workers but by no means do we need these specialised facilities.

    If you want a cool way to benchmark in terms of speed, acuracy, and rate of habituation try GOMS [wikipedia.org]. No testers needed. (For those who know about GOMS, please clean that article up. I haven't had time.)
  • by unoengborg ( 209251 ) on Tuesday October 11, 2005 @03:57PM (#13768301) Homepage
    It's a good thing that we get usability studies on commonly used desktop environments used in Linux, but I think the people who evalute them need to know a little more about Unix/Linux before giving recommendations on how to solve the problems the users encounter.

    One example: In one of the tests the users have problem setting the time. The recommendation is that this should not require root login. And sure that would make the task of setting the time much easier, but it would also possibly break things like kerberos or NFS file sharing. There is also other users to take into account. Letting ordinary users change the time also have security implications as it makes the track record of various loggs useless.

    The proper question to ask, would be why should an ordinary user need to change the time in the first place? Why not make it simpler to hook up to a time server. That way the user wouldn't need to worry.
    What the ordinary user should be allowed to change would be what timezone used in his clock.

It was kinda like stuffing the wrong card in a computer, when you're stickin' those artificial stimulants in your arm. -- Dion, noted computer scientist

Working...