Professional Documents
Culture Documents
When discussing the efficiency of an algorithm, there are three cases that need to be
considered:
the best case,
the worst case,
and the average case.
The best case is how the algorithm will work on the best possible input. The worst case is how
the algorithm runs on the worst possible input. And the average case is how it runs on most
inputs. When comparing algorithms we very rarely use the best case, often use the average
case and sometimes use the worst case.
Well if we use linear sorting on a list with N elements, we have to do N comparisons followed by N -1
comparisons, followed by N -2 comparisons, followed by . . . all the way down to N –N comparisons.
The most significant part of this number is the N2, and we write the number of comparisons as O(N2).
This is known as “Big O” notation.
Linear searching is O(N), and so will be more efficient than linear sorting since N is always smaller
than N2.
Binary searching is O(log N), and so is more efficient than either linear searching or linear sorting
since log N is smaller than N and N2. However, if we sort with linear sort and then search using binary
search, overall that will be less efficient than using linear search.
← 1. O(1) - constant time
← 2. O(logn) - logarithmic time
← 3. O(n) - linear time
← 4. O(nlogn)
← 5. O(nc) - polynomial
← 6. O(cn) - exponential
← 7. O(n!) - factorial
Constant Time - In terms of abstract time, constant times means a constant number of
operations.
Lab 5
Problem 1: Recursive Linear Search
File IntegerListS.java contains a class IntegerListS that represents a list of integers (you may have used a
version of this in an earlier lab); IntegerListSTest.java contains a simple menu-driven test program that lets
the user create, sort, and print a list and search for an element using a linear search.
Many list processing tasks, including searching, can be done recursively. The base case typically involves
doing something with a limited number of elements in the list (say the first element), then the recursive step
involves doing the task on the rest of the list. Think about how linear search can be viewed recursively; if
you are looking for an item in a list starting at index i:
_ If i exceeds the last index in the list, the item is not found (return -1).
_ If the item is at list[i], return i.
_ If the is not at list[i], do a linear search starting at index i+1.
Fill in the body of the method linearSearchR in the IntegerList class. The method should do a recursive
linear search of a list starting with a given index (parameter lo). Note that the IntegerList class contains
another method linearSearchRec that does nothing but call your method (linearSearchR). This is done
because the recursive method (linearSearchR) needs more information (the index to start at) than you want
to pass to the top-level search routine (linearSearchRec), which just needs the thing to look for.
Now change IntegerListTest.java so that it calls linearSearchRec instead of linearSearch when the user asks
for a linear search. Thoroughly test the program.
// ****************************************************************
// IntegerListS.java
//
// Defines an IntegerListS class with methods to create, fill,
// sort, and search in a list of integers. (Version S -
// for use in the linear search exercise.)
//
// ****************************************************************
public class IntegerListS
{
int[] list; //values in the list
// ------------------------------------
// Creates a list of the given size
// ------------------------------------
public IntegerListS (int size)
{
list = new int[size];
}
// --------------------------------------------------------------
// Fills the array with integers between 1 and 100, inclusive
// --------------------------------------------------------------
public void randomize()
{
for (int i=0; i< list.length; i++)
list[i] = (int)(Math.random() * 100) + 1;
}
// ----------------------------------------
// Prints array elements with indices
// ----------------------------------------
public void print()
{
for (int i=0; i<list.length; i++)
System.out.println(i + ":\t" + list[i]);
}
// ------------------------------------------------------------------
// Returns the index of the first occurrence of target in the list.
// Returns -1 if target does not appear in the list.
// ------------------------------------------------------------------
public int linearSearch(int target)
{
int location = -1;
for (int i=0; i<list.length && location == -1; i++)
if (list[i] == target)
location = i;
return location;
}
// -----------------------------------------------------------------
// Returns the index of an occurrence of target in the list, -1
// if target does not appear in the list.
// -----------------------------------------------------------------
public int linearSearchRec(int target)
{
return linearSearchR (target, 0);
}
// -----------------------------------------------------------------
// Recursive implementation of the linear search - searches
// for target starting at index lo.
// -----------------------------------------------------------------
private int linearSearchR (int target, int lo)
{
return -1;
}
// --------------------------------------------------------------------
// Sorts the list into ascending order using the selection sort algorithm.
// --------------------------------------------------------------------
public void selectionSort()
{
int minIndex;
for (int i=0; i < list.length-1; i++)
{
//find smallest element in list starting at location i
minIndex = i;
for (int j = i+1; j < list.length; j++)
if (list[j] < list[minIndex])
minIndex = j;
//swap list[i] with smallest element
int temp = list[i];
list[i] = list[minIndex];
list[minIndex] = temp;
}
}
}
// ****************************************************************
// IntegerListSTest.java
//
// Provide a menu-driven tester for the IntegerList class.
// (Version S - for use in the linear search lab exercise).
//
// ****************************************************************
import java.util.Scanner;
public class IntegerListSTest
{
static IntegerListS list = new IntegerListS (10);
static Scanner scan = new Scanner(System.in);
// ------------------------------------------------------------------
// Creates a list, then repeatedly print the menu and do what the
// user asks until they quit.
// ------------------------------------------------------------------
public static void main(String[] args)
{
printMenu();
int choice = scan.nextInt();
while (choice != 0)
{
dispatch(choice);
printMenu();
choice = scan.nextInt();
}
}
// -------------------------------------
// Does what the menu item calls for.
// -------------------------------------
public static void dispatch(int choice)
{
int loc;
switch(choice)
{
case 0:
System.out.println("Bye!");
break;
case 1:
System.out.println("How big should the list be?");
int size = scan.nextInt();
list = new IntegerListS(size);
list.randomize();
break;
case 2:
list.selectionSort();
break;
case 3:
System.out.print("Enter the value to look for: ");
loc = list.linearSearch(scan.nextInt());
if (loc != -1)
System.out.println("Found at location " + loc);
else
System.out.println("Not in list");
break;
case 4:
list.print();
break;
default:
System.out.println("Sorry, invalid choice");
}
}
// -------------------------------------
// Prints the menu of user's choices.
// -------------------------------------
public static void printMenu()
{
System.out.println("\n Menu ");
System.out.println(" ====");
System.out.println("0: Quit");
System.out.println("1: Create new list elements (** do this first!! **)");
System.out.println("2: Sort the list using selection sort");
System.out.println("3: Find an element in the list using linear search");
System.out.println("4: Print the list");
System.out.print("\nEnter your choice: ");
}
}
lo middle high
lo middle-1 middle+1 high
^^^^
||||
------------- --------------------
first half last half
Fill in the blanks below, then type your code in. Remember when you test the search to first sort the list.
Optional: The binary search algorithm "works" (as in does something) even on a list that is not in order.
Use the algorithm on an unsorted list and show that it may not find an item that is in the list. Hand trace the
algorithm to understand why.
}
return index;
}
// ****************************************************************
// IntegerListB.java
//
// Defines an IntegerList class with methods to create, fill,
// sort, and search in a list of integers. (Version B - for use
// in the binary search lab exercise)
//
// ****************************************************************
public class IntegerListB
{
int[] list; //values in the list
// ------------------------------------
// Creates a list of the given size
// ------------------------------------
public IntegerListB (int size)
{
list = new int[size];
}
// --------------------------------------------------------------
// Fills the array with integers between 1 and 100, inclusive
// --------------------------------------------------------------
public void randomize()
{
for (int i=0; i<list.length; i++)
list[i] = (int)(Math.random() * 100) + 1;
}
// ----------------------------------------
// Prints array elements with indices
// ----------------------------------------
public void print()
{
for (int i=0; i<list.length; i++)
System.out.println(i + ":\t" + list[i]);
}
// ------------------------------------------------------------------
// Returns the index of the first occurrence of target in the list.
// Returns -1 if target does not appear in the list.
// ------------------------------------------------------------------
public int linearSearch(int target)
{
int location = -1;
for (int i=0; i<list.length && location == -1; i++)
if (list[i] == target)
location = i;
return location;
}
// -----------------------------------------------------------------
// Returns the index of an occurrence of target in the list, -1
// if target does not appear in the list.
// -----------------------------------------------------------------
public int binarySearchRec(int target)
{
return binarySearchR (target, 0, list.length-1);
}
// -----------------------------------------------------------------
// Recursive implementation of the binary search algorithm.
// If the list is sorted the index of an occurrence of the
// target is returned (or -1 if the target is not in the list).
// -----------------------------------------------------------------
private int binarySearchR (int target, int lo, int hi)
{
int index;
// fill in code for the search
return index;
}
// ------------------------------------------------------------------------
// Sorts the list into ascending order using the selection sort algorithm.
// ------------------------------------------------------------------------
public void selectionSort()
{
int minIndex;
for (int i=0; i < list.length-1; i++)
{
//find smallest element in list starting at location i
minIndex = i;
for (int j = i+1; j < list.length; j++)
if (list[j] < list[minIndex])
minIndex = j;
//swap list[i] with smallest element
int temp = list[i];
list[i] = list[minIndex];
list[minIndex] = temp;
}
}
}
// ****************************************************************
// IntegerListBTest.java
//
// Provides a menu-driven tester for the IntegerList class.
// (Version B - for use with the binary search lab exerice)
//
// ****************************************************************
import java.util.Scanner;
public class IntegerListBTest
{
static IntegerListB list = new IntegerListB (10);
static Scanner scan = new Scanner(System.in);
// ---------------------------------------------------------------
// Create a list, then repeatedly print the menu and do what the
// user asks until they quit.
// ---------------------------------------------------------------
public static void main(String[] args)
{
printMenu();
int choice = scan.nextInt();
while (choice != 0)
{
dispatch(choice);
printMenu();
choice = scan.nextInt();
}
}
// ----------------------------------------------------
// Does what the menu item calls for.
// ----------------------------------------------------
public static void dispatch(int choice)
{
int loc;
switch(choice)
{
case 0:
System.out.println("Bye!");
break;
case 1:
System.out.println("How big should the list be?");
int size = scan.nextInt();
list = new IntegerListB(size);
list.randomize();
break;
case 2:
list.selectionSort();
break;
case 3:
System.out.print("Enter the value to look for: ");
loc = list.linearSearch(scan.nextInt());
if (loc != -1)
System.out.println("Found at location " + loc);
else
System.out.println("Not in list");
break;
case 4:
System.out.print("Enter the value to look for: ");
loc = list.binarySearchRec(scan.nextInt());
if (loc != -1)
System.out.println("Found at location " + loc);
else
System.out.println("Not in list");
break;
case 5:
list.print();
break;
default:
System.out.println("Sorry, invalid choice");
}
}
// ----------------------------
// Prints the user's choices.
// ----------------------------
public static void printMenu()
{
System.out.println("\n Menu ");
System.out.println(" ====");
System.out.println("0: Quit");
System.out.println("1: Create new list elements (** do this first!! **)");
System.out.println("2: Sort the list using selection sort");
System.out.println("3: Find an element in the list using linear search");
System.out.println("4: Find an element in the list using binary search");
System.out.println("5: Print the list");
System.out.print("\nEnter your choice: ");
}
}
Problem 3:
In the following, use either a direct proof (by giving values for c and n0 in the definition of big-Oh
notation) or cite one of the rules given in the book or in the lecture slides.
(a) Show that if f(n) is O(g(n)) and d(n) is O(h(n)), then f(n)+d(n) is O(g(n)+
h(n)).
Solution Recall the de_nition of big-Oh notation: we need constants c > 0 and n0 _ 1
such that f(n) + d(n) _ c(g(n) + h(n)) for every integer n _ n0.
f(n) is O(g(n)) means that there exists cf > 0 and an integer n0f _ 1 such that
f(n) _ cf g(n) for every n _ n0f . Similarly, d(n) is O(h(n)) means that there exists cd > 0
and an integer n0d _ 1 such that d(n) _ cdh(n) for every n _ n0d.
Let n0 = max(n0f; n0d), and c = max(cf ; cd). So f(n) + d(n) _ cf g(n) + cdh(n) _
c(g(n) + h(n)) for n _ n0. Therefore f(n) + d(n) is O(g(n) + h(n)).
(b) Show that 3(n + 1)7 + 2n log n is O(n7). Hint: Try applying the rules of proposition.
Solution We must _nd the minimum integer n0 such that 10n logn < n2. Since n
describes the size of the input data set that the algorithms operate upon, it will always
be positive. Since n is positive, we may factor an n out of both sides of the inequality,
giving us 10logn < n.Let us consider the left and right hand side of this inequality. These
two functions have one intersection point for n > 1, and it is located between n = 58
and n = 59. Indeed, 10 log 58 _ 58:57981 > 58 and 10 log 59 = 58:82643 < 59. So for
1 _ n _ 58, 10n log n _ n2, and for n _ 59, 10n logn < n2. So n0 we are looking for is
59.
Problem 4:
(a) What does the following algorithm do? Analyze its worst-case running time,
and express it using “Big-Oh" notation.
Solution This algorithm computes an. The running time of this algorithm is O(n)
because
_ the initial assignments take constant time
_ each iteration of the while loop takes constant time
_ there are exactly n iterations
(b) What does the following algorithm do? Analyze its worst-case running time,
and express it using “Big-Oh" notation.
Solution This algorithm does the same thing as the one in 1.a: it computes an. Its
running time is O(log n) for the following reasons:
The initialization and the if statement and its contents take constant time, so we need
to _gure out how many times the while loop gets called. Since k goes down (either gets
halved or decremented by one) at each step, and it is equal to n initially, at worst the loop
gets executed n times. But we can (and should) do better in our analysis.
Note that if k is even, it gets halved, and if it is odd, it gets decremented, and halved
in the next iteration. So at least every second iteration of the while loop halves k. One
can halve a number n at most dlog ne times before it becomes _ 1 (each time we halve a
number we shift it right by one bit, and a number has dlog ne bits). If we decrement the
number in between halving it, we still get to halve no more then dlog ne times. Since we
can only decrement k in between two halving iterations (unless n is odd or it is the last
iteration), we get to do a decrementing iteration at most dlog ne +2 times. So we can have
at most 2dlog ne + 2 iterations. This is obviously O(log n).