GenerativeArt–MadewithUnity
1
Testing & QAOpen Mic
Richard Fine
Buildsystem Team Lead
@superpig
125421Distinct tests run on October 15th
2
In this session
● Hi, I’m Richard
● Quick “State of the Unity” report
● You folks talk!
3
State of the Unity
4
•Write tests in C# using NUnit 3.5-ish
•Run in the Editor and on device
•UTech uses this framework heavily
Unity Test Framework
5
Batch Mode
● Run tests from the command line
● Includes launching tests on devices
● Roll your own test farm
6
•Run your UTF tests in Cloud Build
•Only in-Editor, not on-device (yet)
•Target config in CB dashboard
Unity Cloud Build
7
Unity Performance Reporting
● Capture crashes and exceptions from deployed games
● 2018.3+: now captures custom metadata and the tail of your log file!
● Included with Plus and Pro
8
Unity Bug Reporting (Alpha)
● Create, submit, and catalog bug reports from devices
● Client APIs for attaching metadata, renders, saves, etc
● Access via the Developer Dashboard
9
Performance Testing Framework
● Layer on top of Unity Test Framework to help write performance tests
● Capture times and custom metrics (including e.g. memory usage)
● For more info, see our blog post
10
Graphics Testing Framework (alpha)
● Layer on top of Unity Test Framework to help write ‘golden image’ tests
● Helpers to manage reference images and do image comparisons
● Part of the Scriptable Render Pipeline repository on Github
11
Now, you talk!
● What is QA/Testing like on your project(s) today?
● What’s the biggest unsolved QA problem you have?
● What’s the one piece of advice you would give to your fellow developers
regarding quality and testing?
● What’s the most impactful thing Unity could do to make your QA easier,
faster, better?
12
GenerativeArt–MadewithUnity
Thank you.
13

Testing and QA Open Mic

  • 1.
    GenerativeArt–MadewithUnity 1 Testing & QAOpenMic Richard Fine Buildsystem Team Lead @superpig
  • 2.
    125421Distinct tests runon October 15th 2
  • 3.
    In this session ●Hi, I’m Richard ● Quick “State of the Unity” report ● You folks talk! 3
  • 4.
    State of theUnity 4
  • 5.
    •Write tests inC# using NUnit 3.5-ish •Run in the Editor and on device •UTech uses this framework heavily Unity Test Framework 5
  • 6.
    Batch Mode ● Runtests from the command line ● Includes launching tests on devices ● Roll your own test farm 6
  • 7.
    •Run your UTFtests in Cloud Build •Only in-Editor, not on-device (yet) •Target config in CB dashboard Unity Cloud Build 7
  • 8.
    Unity Performance Reporting ●Capture crashes and exceptions from deployed games ● 2018.3+: now captures custom metadata and the tail of your log file! ● Included with Plus and Pro 8
  • 9.
    Unity Bug Reporting(Alpha) ● Create, submit, and catalog bug reports from devices ● Client APIs for attaching metadata, renders, saves, etc ● Access via the Developer Dashboard 9
  • 10.
    Performance Testing Framework ●Layer on top of Unity Test Framework to help write performance tests ● Capture times and custom metrics (including e.g. memory usage) ● For more info, see our blog post 10
  • 11.
    Graphics Testing Framework(alpha) ● Layer on top of Unity Test Framework to help write ‘golden image’ tests ● Helpers to manage reference images and do image comparisons ● Part of the Scriptable Render Pipeline repository on Github 11
  • 12.
    Now, you talk! ●What is QA/Testing like on your project(s) today? ● What’s the biggest unsolved QA problem you have? ● What’s the one piece of advice you would give to your fellow developers regarding quality and testing? ● What’s the most impactful thing Unity could do to make your QA easier, faster, better? 12
  • 13.