Outerra forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

Download Outerra Tech Demo. Unofficial Outerra Discord server, MicroProse Discord server for OWS.

Pages: [1] 2 3 4

Author Topic: Performance testing  (Read 93928 times)

cameni

  • Brano Kemen
  • Outerra Administrator
  • Hero Member
  • *****
  • Posts: 6721
  • No sense of urgency.
    • outerra.com
Performance testing
« on: January 09, 2016, 09:59:29 am »

Hi everybody

A while ago we decided to make a few tests measuring the rendering performance of modern GPUs, that should help us decide the optimal rendering strategy and data layout for various types of rendering tasks an upcoming features. We ran the tests on a couple of graphics cards, and the preliminary results of these tests are very interesting, for example here are graphs from our procedural grass test:

Raw performance Mtris/s


Performance/price, Mtris/s per dollar


In order to gather more complete data, we would like to ask you to download the performance test, and after unpacking run the two test suites there: grass_test.bat and buildings_test.bat
When each tests completes, you will see your score, and you will be asked to send the results to us so we can incorporate results from different hardware into our results.

Please note that the test program requires OpenGL 4.x drivers and it may not run on some older cards that only support OpenGL 3.x. Also, the test program requires 64-bit Windows.
If you run dctest64.exe alone, you will see a different test that will be ready later. This initial build is mainly testing procedural rendering, whereas the following one will deal with model rendering performance.

You can download the test here: outerra_perf_tests.zip
Run grass_test.bat and after it finishes also buildings_test.bat

Thanks for your help! Complete results will be published on Outerra blog together with comments.
« Last Edit: July 11, 2016, 03:21:11 am by cameni »
Logged

HiFlyer

  • Hero Member
  • *****
  • Posts: 1788
  • newbie
Re: Performance testing
« Reply #1 on: January 09, 2016, 10:08:11 am »

Mcafee Antivirus hates this file!  :P =D

Web detect did'nt want to let me download it, but it runs fine.
« Last Edit: January 09, 2016, 10:11:14 am by HiFlyer »
Logged
Spex: Intel Core i7 6700K @ 4.6GHz / 32.0GB G.SKILL TridentZ Series Dual-Channel Ram / ASUS STRIX GeForce GTX 1080 / Sound Blaster Z / Oculus Rift VR Headset / Klipsch® Promedia 2.1 Computer Speakers / ASUS ROG SWIFT PG279Q ‑ 27" IPS LED Monitor ‑ QHD / 2x Samsung SSD 850 EVO 500GB / Windows 10 Pro

cameni

  • Brano Kemen
  • Outerra Administrator
  • Hero Member
  • *****
  • Posts: 6721
  • No sense of urgency.
    • outerra.com
Re: Performance testing
« Reply #2 on: January 09, 2016, 10:16:15 am »

Hmm I should probably sign the exe to lessen their worries :)
Logged

Jagerbomber

  • Hero Member
  • *****
  • Posts: 1564
Re: Performance testing
« Reply #3 on: January 09, 2016, 10:50:26 am »

Hmm... Lower set of cards than I expected.

Before I do, you think this is busted with the current latest Nvidia drivers like Outerra is?
Logged
"Perhaps this speaks to some larger trend within society today...  A prevailing desire on the part of indie developers to recreate the entire world into one where you can charge more than $15 for your game design degree coursework." - Yahtzee ;) :P

KW71

  • Outerra Developer
  • Hero Member
  • *****
  • Posts: 762
  • Love OT!
Re: Performance testing
« Reply #4 on: January 09, 2016, 12:05:25 pm »

Both tests run just fine, but dctest64.exe just crash when I want to send the results (this .exe is correctly allowed in Comodo antivirus).

After many attempts and in a moment of luck I was able the send the grass results (I didn't anything different), but I have had no luck to send the buildings test result.
Logged
"A man who is contented with what he has done, will never become famous for what he will do".

cameni

  • Brano Kemen
  • Outerra Administrator
  • Hero Member
  • *****
  • Posts: 6721
  • No sense of urgency.
    • outerra.com
Re: Performance testing
« Reply #5 on: January 09, 2016, 12:39:51 pm »

you think this is busted with the current latest Nvidia drivers like Outerra is?

For the test it doesn't matter much, performance doesn't change.
We reported the bug to NV, it's just one specific problem with mipmaps of compressed texture arrays, which aren't used in the test anyway.
Logged

booz

  • Jr. Member
  • *
  • Posts: 14
Re: Performance testing
« Reply #6 on: January 09, 2016, 03:44:00 pm »

Same here, Error "Failed to upload test results".
Logged

cameni

  • Brano Kemen
  • Outerra Administrator
  • Hero Member
  • *****
  • Posts: 6721
  • No sense of urgency.
    • outerra.com
Re: Performance testing
« Reply #7 on: January 09, 2016, 04:55:49 pm »

There were some issues with antivirus and resolving the address to send to, I've updated the test suite.
Logged

aWac9

  • Hero Member
  • *****
  • Posts: 2601
  • newbie
Re: Performance testing
« Reply #8 on: January 09, 2016, 05:01:44 pm »

houston here,,, smoothly. sent a favorable report. stop. (not despair,, no out ... expect the end,,,, it takes about three or four minutes)
Note: After report remains sound of birds in my computer.

:)
« Last Edit: January 10, 2016, 05:21:14 am by aWac9 »
Logged

Jagerbomber

  • Hero Member
  • *****
  • Posts: 1564
Re: Performance testing
« Reply #9 on: January 09, 2016, 08:39:00 pm »

My 4GB 770 building test was over 2500, but only 2111 for grass...  =|
Logged
"Perhaps this speaks to some larger trend within society today...  A prevailing desire on the part of indie developers to recreate the entire world into one where you can charge more than $15 for your game design degree coursework." - Yahtzee ;) :P

HiFlyer

  • Hero Member
  • *****
  • Posts: 1788
  • newbie
Re: Performance testing
« Reply #10 on: January 09, 2016, 09:19:04 pm »

My 4GB 770 building test was over 2500, but only 2111 for grass...  =|

My 2GB 770 received 2179 for Grass, 2565 for the building test. Pretty even.
Logged
Spex: Intel Core i7 6700K @ 4.6GHz / 32.0GB G.SKILL TridentZ Series Dual-Channel Ram / ASUS STRIX GeForce GTX 1080 / Sound Blaster Z / Oculus Rift VR Headset / Klipsch® Promedia 2.1 Computer Speakers / ASUS ROG SWIFT PG279Q ‑ 27" IPS LED Monitor ‑ QHD / 2x Samsung SSD 850 EVO 500GB / Windows 10 Pro

Revolver

  • Hero Member
  • *****
  • Posts: 672
  • Adlerhorst-Hangar Design Group ©
Re: Performance testing
« Reply #11 on: January 10, 2016, 03:01:49 am »

Hi Brano,

have all tests performed with score: ~ 5000 +
and I still got an old (358.5) driver.
Graka ran into a standard-state (not overclocked).

Do you need screens that?
Logged
"Es gibt nur eine Sünde, die gegen die ganze Menschheit mit allen ihren Geschlechtern begangen
werden kann, und dies ist die Verfälschung der Geschichte."(F.Hebbel)


cameni

  • Brano Kemen
  • Outerra Administrator
  • Hero Member
  • *****
  • Posts: 6721
  • No sense of urgency.
    • outerra.com
Re: Performance testing
« Reply #12 on: January 10, 2016, 03:09:09 am »

Score 5000? What monster is it? :)

Have you sent the report from the test? I have uploaded a newer version to address some problems in sending the reports.
Logged

cameni

  • Brano Kemen
  • Outerra Administrator
  • Hero Member
  • *****
  • Posts: 6721
  • No sense of urgency.
    • outerra.com
Re: Performance testing
« Reply #13 on: January 10, 2016, 03:30:43 am »

My 4GB 770 building test was over 2500, but only 2111 for grass...  =|

These tests count triangles sent to the card, but there's a difference between grass and buildings - grass has triangle backface culling off, rendering triangles even if they are facing backwards to the viewer, and therefore the triangle throughput also equals the rendered triangle throughput.

With buildings and any other closed objects you generally have 1/2 of the triangles invisible and culled off before they get to the rasterizer. Hence, if we tried to compare grass and buildings directly, we should rather compare rendered triangles, and that would be ~1250 for buildings vs 2111 for the grass.
Logged

Revolver

  • Hero Member
  • *****
  • Posts: 672
  • Adlerhorst-Hangar Design Group ©
Re: Performance testing
« Reply #14 on: January 10, 2016, 05:57:13 am »

Score 5000? What monster is it? :)

Have you sent the report from the test? I have uploaded a newer version to address some problems in sending the reports.

This is the monster, Sir! :) After my old 580GTX has acknowledged his service I've brought this to me since.
And YES, I have about ~1100+ fps in buildings-test,
and about ~ 900 + fps at grass-test.
http://www.techpowerup.com/gpudb/b3318/evga-gtx-980-ti-hybrid.html

p.s. OK, I got your new test upload and run several times. Now there went with Test send and you can see you even results.
When (dctest64) I get 412 min. / max 429 FPS. ;)
« Last Edit: January 10, 2016, 06:31:39 am by AH-DG »
Logged
"Es gibt nur eine Sünde, die gegen die ganze Menschheit mit allen ihren Geschlechtern begangen
werden kann, und dies ist die Verfälschung der Geschichte."(F.Hebbel)


Pages: [1] 2 3 4