Table of Contents

How to use ChatGPT for Data Analysis

ChatGPT Advanced Data Analysis: Use Cases and Performance

Limitations of using ChatGPT for Data Analytics

Will AI take over data analytics?

Using ChatGPT for Data Analysis: Use Cases and Limitations

Why LLM is not enough for data analytics

Using ChatGPT for Data Analysis

ChatGPT, a generative AI chatbot based on a large language model, has seen a rapid rise in popularity. Its ability to understand and generate human-like text has opened new opportunities for technological applications and real-life use cases. This article focuses on using ChatGPT for data analysis, an area where its capabilities are both promising and challenging.

How to use ChatGPT for Data Analysis

ChatGPT, developed by OpenAI, is a conversational agent designed to understand and generate human language. It's powered by a large language model, which allows it to interpret and respond to a wide range of text inputs.

To use ChatGPT for data analytics, a ChatGPT Plus subscription is required since file upload is not available for free users. ChatGPT Advanced Data Analysis is a feature within ChatGPT that allows users to upload data directly to ChatGPT and ask questions about the data.

ChatGPT Advanced Data Analysis: Can You Use ChatGPT to Analyze Data?

Using ChatGPT for data analysis can be a powerful way to leverage AI in understanding and interpreting data. Here are some practical applications:

  • Data Querying and Interpretation: ChatGPT can handle requests for data analysis, providing summaries and interpretations based on provided datasets.
  • Predictive Analytics and Pattern Recognition: Leveraging its language model, ChatGPT can identify trends in the historical data.
  • Assisting in Data Visualization: It can generate textual data trends descriptions and charts, aiding in the visualization process.

ChatGPT Advanced Data Analysis: Use Cases and Performance

We leveraged ChatGPT's Advanced Data Analysis feature in various contexts, where it demonstrated both versatility and its limitations. Here’s a summary of how it performed in different scenarios.

Using ChatGPT for Advertising Data Analysis

Tools: Custom GPT, Code Interpreter.

Dataset: Arbitrary dataset with structured advertising data.

In this example, we used Code Interpreter and requested a Custom GPT to analyze and generate insights from an arbitrary advertising dataset with structured data. ChatGPT successfully created visualizations and identified key metric trends, such as cost, revenue, click-through rate (CTR), and conversions. While it pinpointed top-performing traffic sources and offered actionable suggestions, the final recommendations were generally broad and not actionable.

Using ChatGPT to Analyze SEO Data (Google Search Console)

Tools: Custom GPT, Code Interpreter.

Dataset: Google Search Console Data Export.

In another case, we asked a Custom GPT to suggest SEO improvements. When analyzing Google Search Console Data, ChatGPT offered a regional performance comparison and recognized date-wise trends. Its analysis of top queries, search appearance, and devices led to valid, actionable recommendations. However, when asked about page performance it provided non-existent page URLs (data hallucination).

Using ChatGPT to Analyze Product Events Data

Tools: Custom GPT, Code Interpreter.

Dataset: Mixpanel MAU data.

In this example, a custom GPT was used to analyze and generate insights from Mixpanel MAU data. In analyzing Mixpanel's Monthly Active Users (MAU) data, ChatGPT produced visualizations and trendlines for key metrics. Although it provided a general overview of the data, both the observations and the recommendations lacked depth, emphasizing the need for more detailed, context-specific insights.

Using ChatGPT for Customer Feedback Analysis

Tools: Custom GPT, Code Interpreter.

Dataset: Arbitrary customer feedback dataset with unstructured text.

ChatGPT's performance in analyzing unstructured text from customer feedback highlighted its limitations in handling incomplete data. It struggled with fields that were not fully populated, only generating insights from fully completed columns. Nonetheless, the insights it did provide were valid and well-summarized, showing its potential in text analysis when provided with complete data.

In all of the scenarios mentioned, ChatGPT was able to process and analyze data to some degree. However, the observations made contained errors (data hallucinations) and were often too generic, lacking specificity and detail.

What are the Limitations of Data Analysis in ChatGPT?

AI-powered tools like ChatGPT mainly use a conversation style for interaction, which isn't always the best way to work with data. SQL, for example, was made to be somewhat like English, and getting answers from data through structured query language or query-builders might be more practical and accurate. Moreover, when chatting with data in plain English, users need to know exactly what questions to ask. Along with this, there are other limitations:

  • Lack of Accuracy: LLM models are trained to provide results (predict tokens) and incentivized to provide a generated output, even if the result is not accurate (“AI hallucinations” phenomena).
  • Handling Large Datasets: ChatGPT struggles with processing large or complex datasets.
  • Dependence on User Input: The quality of output depends heavily on the user's ability to ask the right questions (prompts).
  • Data Privacy and Security Challenges: Handling sensitive data raises concerns about privacy and security.
  • Unprepared Data: ChatGPT faces challenges with unstructured or unprepared data.
  • Lack of Contextual Business Understanding: It lacks a deep understanding of specific business contexts.
  • Manual Data Upload: Users have to upload files to ChatGPT, with no option to connect existing sources (unlike tools like AI Data Analyst).

In addition to these limitations, over-reliance on AI for data interpretation can lead to misinterpretation and overlook crucial nuances that human analysts or rules-based non-AI systems might catch.

Overcoming Limitations of ChatGPT

Utilizing ChatGPT effectively in data analysis involves crafting precise prompts and understanding its scope and limitations.

Exploring other AI-powered data analysis tools, like Narrative BI, which offers customized solutions based on specialized Generative BI model, can help you avoid ChatGPT's hallucinations.

Anticipated improvements in AI models could enhance data analytics capabilities, making AI interfaces more robust and insightful.

Will AI take over data analytics?

While ChatGPT offers exciting possibilities in data analysis, it's crucial to be aware of its limitations and the need for human oversight. The role of AI in data analytics is evolving, and ChatGPT is a significant, albeit limited, part of this landscape.

Unlike ChatGPT, trained for generic tasks, Generative BI solutions offer more specialized functions and deeper insights compared to chat-based AI.

Consider trying Narrative BI, a generative business intelligence platform, for a more tailored data analysis experience, especially if you're seeking insights beyond what generic models like ChatGPT can offer.

Share on

Facebook logo
Facebook
LinkedIn logo
LinkedIn
X logo
X

Related articles

Read more
9 min

Analytics

Generative AI for Data Analytics: Making Data Insights Accessible

Michael Rumiantsau
28
Nov 2023
Read more
8 min

Analytics

Generative BI: Setting a New Standard for Business Intelligence

Michael Rumiantsau
16
Nov 2023
Read more
6 min

Analytics

Generative AI for Marketing: Unlocking New Growth Opportunities

Michael Rumiantsau
14
Dec 2023

Resources for data-driven founders & growth leaders

Learn how to turn your data into a powerful asset that helps you achieve mission-critical goals.
By signing up, you agree to our
Privacy Policy
and
Terms of service.

Thank you for your interest!

Please leave your email address to learn more about Narrative BI and be the first to try our platform.
Narrative BI Close button
Thank you!
We’re so glad you’re interested in seeing Narrative BI in action
Narrative BI Close button

Thank you for your interest!

Please leave your email address and we will get back to you to learn more about your specific needs.
Narrative BI Close button

Pro Tip

Did you know that Narrative BI makes tracking your marketing performance effortless? It connects to your digital marketing channels and generates automated reports and alerts.

No more manual work, spreadsheets, and data silos. Narrative BI generates natural language insights in an easy-to-read format so you can focus on growth.

Try Narrative BI for free
integrations

Effortless integration

Connect your favorite data sources in two clicks and start receiving marketing reports and actionable insights today!

Connect your data sources
Effortless integration
Curt Cuscino

Encapsulates Marketing + Advertising Performance Data to Work Smarter, Not Harder

Google Analytics is ultra-powerful when it comes to managing our clients’ MarTech stacks, but it’s easy to get lost in the overwhelming amount of data there. Narrative has given us a way to get “just the good stuff”, and the most important metrics we need for making daily decisions on behalf of my agency’s clients from Analytics to Ad Spends. The condensed insights we get from Narrative are incredibly helpful, and now indispensable in our daily mix of tools.

George Pohl

Narrative BI is well suited for SME's!

Narrative firstly is a great tool for beginners in marketing analytics - it allows all of our team - even non-technical / analytical get involved! As Mark Ritson said, 'The average is the enemy of the marketer' and Narrative helps us fight that battle every day. Instead of wading through averages, we can spot and evaluate the outliers, the true insights.