Tech Insider					     Technology and Trends

			      USENET Archives

From: (Bart Miller)
Subject: Random testing tech report
Date: 1995/04/14
Message-ID: <3mmae0$>#1/1
X-Deja-AN: 100441562
organization: U of Wisconsin CS Dept
newsgroups: comp.sources.testers,

A new tech report is available on the testing and reliability of UNIX utilities
and servers.  The short summary is that we can crash lots of programs on lots
of vendors' machines, using very simple techniques.  We report on the testing
and describe why the programs crash.  You can fetch the paper at:

The abstract for the report follows:

    "Fuzz Revisited: A Re-examination of the Reliability of
    UNIX Utilities and Services"

    Barton P. Miller, David Koski, Cjin Pheow Lee, Vivekananda Maganty,
    Ravi Murthy, Ajitkumar Natarajan, and Jeff Steidl


    We have tested the reliability of a large collection of basic UNIX utility
    programs, X-Window applications and servers, and network services. We used
    a simple testing method of subjecting these programs to a random input
    stream.  Our testing methods and tools are largely automatic and simple to
    use. We tested programs on nine versions of the UNIX operating system,
    including seven commercial systems and the freely-available GNU utilities
    and Linux.  We report which programs failed on which systems, and identify
    and categorize the causes of these failures.

    The result of our testing is that we can crash (with core dump) or hang
    (infinite loop) over 40% (in the worst case) of the basic programs and
    over 40% of the X-Window applications. We were not able to crash any of
    the network services that we tested nor any of X-Window servers. This
    study parallels our 1990 study (that tested only the basic UNIX utilities);
    all systems that we compared between 1990 and 1995 noticeably improved in
    reliability, but still had significant rates of failure. The reliability of
    the basic utilities from GNU and Linux were noticeably better than those of
    the commercial systems.

    We also tested how utility programs checked their return codes from the
    memory allocation library routines by simulating the unavailability of
    virtual memory. We could crash almost half of the programs that we tested
    in this way.

			        About USENET

USENET (Users’ Network) was a bulletin board shared among many computer
systems around the world. USENET was a logical network, sitting on top
of several physical networks, among them UUCP, BLICN, BERKNET, X.25, and
the ARPANET. Sites on USENET included many universities, private companies
and research organizations. See USENET Archives.

		       SCO Files Lawsuit Against IBM

March 7, 2003 - The SCO Group filed legal action against IBM in the State 
Court of Utah for trade secrets misappropriation, tortious interference, 
unfair competition and breach of contract. The complaint alleges that IBM 
made concentrated efforts to improperly destroy the economic value of 
UNIX, particularly UNIX on Intel, to benefit IBM's Linux services 
business. See SCO vs IBM.

The materials and information included in this website may only be used
for purposes such as criticism, review, private study, scholarship, or

Electronic mail:			       WorldWideWeb: