Download Free Report

OpenAI’s ChatGPT Coding Capabilities Analysis: Can It Pass QA?

We decided to put it to the test and to share our findings with you.

The swift advancements in generative AI have captivated us in recent months, and like everyone else, we’ve been experimenting with it and eager to understand its effects on both our personal and professional lives.

As a QA software testing firm with over 20 years of experience in testing code for customers with large and small businesses, we naturally wondered, “But will the code generated by GPT pass QA?”. So we put it to the test and decided to share our findings with you.

Our testing included generating code for multiple different programming languages including JAVA, .NET, Perl, Python, Apex, JavaScript, and Lua.

 

The Tests Included Varying Levels of Complexity and Were Evaluated For

  • % use cases covered
  • Solution innovation
  • Adherence to coding conventions
  • Best practices
  • Code readability
  • Performance
  • Security vulnerabilities
  • Comments & beautification

What You Will Get in This Report

  • Methodology
  • Prompts
  • The output of the code that was created
  • Code Analysis
What You Will Get in This Report on OpenAI’s ChatGPT Coding Capabilities Analysis

Why QASource?

One of the things that’s really great about the QASource team is you have a lot of confidence in what they do because they ask questions.
SilkRoad

Free Report: ChatGPT Code: Will It Pass QA?

Our Clients