From octave-maintainers-request at bevo dot che dot wisc dot edu Mon Jan 26 08:24:46 2004 Subject: Re: benchmarks From: David Bateman To: Paul Kienzle Cc: octave-maintainers at bevo dot che dot wisc dot edu Date: Mon, 26 Jan 2004 15:20:51 +0100 I ran the sciviews benchmarks under Matlab R12 and octave 2.1.53 with my eigenvalues patch, sort and the rand/randn code from Paul with my ziggurat code in it. I used atlas and fftw. I also replaced tic/toc with cputime in the scripts as being fairer. The logs are below. The only tests where we are really off the game are now the last 2, which as Paul says will need a lot of work. We are also a bit slow on the FFT, which is odd as I used FFTW. Maybe the interface to octave needs checking.. The sorting is slightly slower, but they aren't testing partially ordered list where the new code blows matlab away. It might be worth pointing the author of these benchmarks to a 2.1.54 release and a 2004 release of octave-forge when they are available :-) Cheers David Matlab Benchmark 2 ================== Number of times each test is run__________________________: 3 I. Matrix calculation --------------------- Creation, transp., deformation of a 1500x1500 matrix (sec): 0.75 800x800 normal distributed random matrix ^1000______ (sec): 0.19667 Sorting of 2,000,000 random values__________________ (sec): 1.11 700x700 cross-product matrix (b = a' * a)___________ (sec): 0.91333 Linear regression over a 600x600 matrix (c = a \ b') (sec): 0.33 ------------------------------------------------------ Trimmed geom. mean (2 extremes eliminated): 0.60916 II. Matrix functions -------------------- FFT over 800,000 random values______________________ (sec): 0.46333 Eigenvalues of a 320x320 random matrix______________ (sec): 0.99667 Determinant of a 650x650 random matrix______________ (sec): 0.31333 Cholesky decomposition of a 900x900 matrix__________ (sec): 0.4 Inverse of a 400x400 random matrix__________________ (sec): 0.23 ------------------------------------------------------ Trimmed geom. mean (2 extremes eliminated): 0.38725 III. Programmation ------------------ 750,000 Fibonacci numbers calculation (vector calc)_ (sec): 1.0933 Creation of a 2250x2250 Hilbert matrix (matrix calc) (sec): 1.2233 Grand common divisors of 70,000 pairs (recursion)___ (sec): 0.57667 Creation of a 220x220 Toeplitz matrix (loops)_______ (sec): 0.48667 Escoufier's method on a 37x37 matrix (mixed)________ (sec): 1.35 ------------------------------------------------------ Trimmed geom. mean (2 extremes eliminated): 0.91708 Total time for all 15 tests_________________________ (sec): 10.4333 Overall mean (sum of I, II and III trimmed means/3)_ (sec): 0.60031 --- End of test --- Octave Benchmark 2 ================== Number of times each test is run__________________________: 3 I. Matrix calculation --------------------- Creation, transp., deformation of a 1500x1500 matrix (sec): 0.9433 800x800 normal distributed random matrix ^1000______ (sec): 0.2167 Sorting of 2,000,000 random values__________________ (sec): 1.923 700x700 cross-product matrix (b = a' * a)___________ (sec): 0.9267 Linear regression over a 600x600 matrix (c = a \ b') (sec): 0.3833 ------------------------------------------------------ Trimmed geom. mean (2 extremes eliminated): 0.6946 II. Matrix functions -------------------- FFT over 800,000 random values______________________ (sec): 0.6 Eigenvalues of a 320x320 random matrix______________ (sec): 0.9367 Determinant of a 650x650 random matrix______________ (sec): 0.4567 Cholesky decomposition of a 900x900 matrix__________ (sec): 0.45 Inverse of a 400x400 random matrix__________________ (sec): 0.27 ------------------------------------------------------ Trimmed geom. mean (2 extremes eliminated): 0.4977 III. Programmation ------------------ 750,000 Fibonacci numbers calculation (vector calc)_ (sec): 0.6967 Creation of a 2250x2250 Hilbert matrix (matrix calc) (sec): 0.9533 Grand common divisors of 70,000 pairs (recursion)___ (sec): 0.5667 Creation of a 220x220 Toeplitz matrix (loops)_______ (sec): 2.963 Escoufier's method on a 37x37 matrix (mixed)________ (sec): 2.68 ------------------------------------------------------ Trimmed geom. mean (2 extremes eliminated): 1.212 Total time for all 15 tests_________________________ (sec): 14.97 Overall mean (sum of I, II and III trimmed means/3)_ (sec): 0.7483 --- End of test --- -- David Bateman David dot Bateman at motorola dot com Motorola CRM +33 1 69 35 48 04 (Ph) Parc Les Algorithmes, Commune de St Aubin +33 1 69 35 77 01 (Fax) 91193 Gif-Sur-Yvette FRANCE The information contained in this communication has been classified as: [x] General Business Information [ ] Motorola Internal Use Only [ ] Motorola Confidential Proprietary