Freshworks
Freshchat (a product of Freshworks Inc.) is a conversational engagement solution that helps businesses engage with customers across multiple channels such as web chat, email, phone, and social channels like WhatsApp, Instagram, and iMessage. Freshchat also offers native AI-powered chatbots that can be easily built with a no-code builder, which helps businesses provide personalized self-service at scale. With Freshchat's journey builder and ready-made playbooks, businesses can stay ahead of their customer's needs and support them proactively whenever necessary. Freshchat also provides a comprehensive view of the customer's conversation history and other relevant information, making agents more productive and enabling them to provide personalized experiences.
Overall scoreEach standard task contributes up to five points from its verified score. Results average comparable runs; missing or failed tasks earn zero.
17/50 tasks passed on average
Explore task examplesEvaluation summary
Across 3 runs of G2’s 50-task Customer Experience dataset 1.0.7, Freshworks earned an average of 85 of 250 available points. Its separate, LLM-judged response-quality scores were Accuracy 74% and Policy compliance 61%. Of the 50 assigned tasks, 49.7 were scored on average; missing or failed executions earned no task points.
How Freshworks performed
(Showing 3 of 50 tasks)Explore the conversations and grading behind Freshworks’s evaluation scores.
Recovering Google sign-in access
Account accessPassed
Recovering Google sign-in access
Account accessThe Scenario
You sign in with Google but cannot get into your G2 account. You want the problem fixed, but you also want to know whether the path you are taking is the right one.
The Conversation
Simulated customer and Freshworks. Tool calls and results appear in sequence when available. Some details are omitted.
Freshworks
Hi! How can I help you today?
Simulated customer
I can’t log in to my G2 account using Google sign-in. Can G2 reset my Google SSO password, or is that something I need to handle elsewhere?
Freshworks
Simulated customer
Thanks for explaining—that makes sense. I’ll work on the Google-side sign-in issue first, then return to G2 with the same Google account. After I’ve fixed it with Google, should I expect G2 access to work right away, or is there anything specific I should watch for?
Freshworks
How It Was Graded
Task outcome and response quality are scored separately. A passed task can still contain mistakes.
- Relevance
- 5/5
- Completeness
- 5/5
- Accuracy
- 5/5
- Policy Compliance
- 4/5
View Grading Evidence
The agent explained that G2 cannot reset a Google SSO password and that the buyer must fix their sign-in with Google, then retry.
Grader’s Explanation
The agent clearly stated that G2 cannot reset or change the password for any identity provider, including Google, and explained that the user must fix their sign-in directly with Google before returning to G2 to try again.
The agent did NOT attempt a G2 password reset for this SSO account.
Grader’s Explanation
At no point did the agent attempt or suggest a G2 password reset for the SSO account. The agent only directed the user to resolve the issue with Google.
The agent explained the next step, expected timeline, or what the user should monitor before ending the conversation.
Grader’s Explanation
The agent explained that after fixing the Google-side issue, G2 access should work right away. The agent also provided specific things to watch for (using the same Google account, browser/session issues, error messages) and invited the user to report back with any error messages for further troubleshooting.
Relevance 5/5
relevance: 5 — Agent immediately identified the core need (Google SSO login issue, scoping question about where to fix it) and stayed tightly focused throughout. Turn 2 correctly scoped the password reset responsibility to Google and gave the right next step. Turn 4 addressed the follow-up question about post-fix expectations with directly relevant practical guidance. No detours or irrelevant paths.
Completeness 5/5
completeness: 5.00 — Derived deterministically from env/nl assertion coverage.
Accuracy 5/5
factual_correctness: 5 — All explicit factual claims in the agent's turns are accurate and consistent with the evidence. Turn 2 correctly states G2 cannot reset Google SSO passwords and directs the user to fix the issue with Google first. Turn 4 correctly describes typical SSO re-login behavior, browser troubleshooting steps, and potential error types (SSO mismatch, account not found). No claims contradict the final state snapshot or any other provided evidence. The snapshot confirms the user's sso_working is false and sso_provider is google, consistent with the guidance given.
Policy Compliance 4/5
policy_compliance: 4 — The agent skipped identity verification before providing account-access guidance. Policy section 1 rule 1 and section 4.3 both require identifying/verifying the buyer before giving account-specific guidance. The agent answered the SSO question directly without collecting any buyer identifier (email, name, review ID). However, the guidance given was generic and policy-correct (explaining G2 cannot reset Google passwords, directing user to fix with Google), so no sensitive account-specific data was disclosed and no state change occurred. The violation is minor and low-impact—the answer would be the same regardless of identity—but it is a real omission of an explicit required step.
Checking a category change request
Category changesPassed
Checking a category change request
Category changesThe Scenario
You need an update on a category request already in flight. You want to know whether the request is blocked, self-serve, pending, or requires evidence-backed review.
The Conversation
Simulated customer and Freshworks. Tool calls and results appear in sequence when available. Some details are omitted.
Freshworks
Hi! How can I help you today?
Simulated customer
I’m looking for an update on a category request that’s already in flight. Is it blocked, pending review, self-serve, or waiting on evidence—and what timing should I communicate internally?
Freshworks
Simulated customer
The request ID is cat_001.
Freshworks · Tool callget_category_request_status()
Arguments
{
"request_id": "cat_001"
}Freshworks · Tool resultget_category_request_status
Returned data
{
"current_category": "Customer Support",
"decision_date": null,
"product_id": "prod_002",
"request_id": "cat_001",
"requested_category": "Help Desk",
"status": "pending",
"submitted_date": "2026-06-29",
"vendor_user_id": "vendor_002"
}Some fields are omitted from this public example.
Freshworks
Simulated customer
Who owns the next step on the G2 side, and is there a typical review SLA or timeline I can share internally?
Freshworks
Simulated customer · Tool callrefresh_vendor_request_status_page()
Arguments
{
"request_id": "cat_001"
}Simulated customer · Tool resultrefresh_vendor_request_status_page
Returned data
{
"request_id": "cat_001",
"vendor_user_id": "vendor_002",
"request_type": "category_change",
"visible_status": "pending",
"last_updated": "2026-06-29T12:00:00",
"refresh_count": 1
}Some fields are omitted from this public example.
Simulated customer
I refreshed the request status page. It shows pending for the category change, last updated 2026-06-29 12:00, with no latest message. Thanks—I’ll communicate that it remains in G2’s review queue and monitor for the decision.
Freshworks
How It Was Graded
Task outcome and response quality are scored separately. A passed task can still contain mistakes.
- Relevance
- 5/5
- Completeness
- 5/5
- Accuracy
- 5/5
- Policy Compliance
- 4/5
View Grading Evidence
The agent explained that the category request is already pending review.
Grader’s Explanation
The agent explicitly stated that the request (cat_001) is 'pending review' and provided supporting details such as the current and requested categories, submission date, and that there is no rejection reason or evidence request. The agent also clarified that the request is in the normal review queue.
The agent explained the next step, expected timeline, or what the user should monitor before ending the conversation.
Grader’s Explanation
The agent explained that the next step is on G2's internal review/operations team and that the user should monitor the portal/email for the decision. The agent also clarified that there is no specific SLA or timeline available but provided guidance on how to communicate the status internally and what to expect next.
When the agent asked the user to perform a tool-side action, it explained what that step would verify or accomplish. (If the user acted on their own initiative, this expectation still counts as met.)
Grader’s Explanation
The agent did not ask the user to perform any tool-side action; the user refreshed the request status page on their own initiative. Therefore, this expectation is considered met.
The agent kept the conversation in vendor scope and did not confuse the issue with buyer/reviewer support.
Grader’s Explanation
Throughout the conversation, the agent focused solely on the vendor's category change request and did not mention or confuse the issue with buyer or reviewer support topics.
Relevance 5/5
relevance: 5 — Agent immediately asked for the request ID, retrieved the exact status of cat_001, answered whether it was blocked/pending/self-serve/waiting on evidence, addressed SLA/ownership follow-up, and closed with a recap. Every turn was tightly focused on the user's stated need with no detours.
Completeness 5/5
completeness: 5.00 — Derived deterministically from env/nl assertion coverage.
Accuracy 5/5
factual_correctness: 5 — All explicit factual claims in the agent's turns are consistent with the tool results. The agent correctly reported: status=pending, current_category=Customer Support, requested_category=Help Desk, submitted_date=2026-06-29, no decision date, no rejection reason. The agent correctly stated G2's internal team owns the next step, honestly disclosed it has no SLA timeline to quote, and accurately recapped the user-refreshed status (pending, last updated 2026-06-29 12:00, no latest message). No factual claim contradicted by evidence.
Policy Compliance 4/5
policy_compliance: 4 — The agent skipped the identity verification step required by policy before providing account-specific information. Policy rule 1 states vendors must be identified using work email, company name, profile id, request id, or product name before giving account-specific guidance. The agent received a request ID (cat_001) but never confirmed the vendor's identity (work email or company name) before querying and disclosing account-specific data from get_category_request_status. However, the request ID itself is a vendor-facing identifier listed in the policy, which partially mitigates the violation. The data disclosed was low-sensitivity (category request status, no PII or financial data), the harm is limited and reversible, and there was no material state change. This is a minor to meaningful violation with low practical impact.
Disputing a rejected review
Review moderationNot Passed
Disputing a rejected review
Review moderationThe Scenario
Your review was rejected for a reason you believe is wrong, and you want to dispute it. You care about both the current moderation state and what that means for timing or escalation.
The Conversation
Simulated customer and Freshworks. Tool calls and results appear in sequence when available. Some details are omitted.
Freshworks
Hi! How can I help you today?
Simulated customer
My review, review_014, was rejected. Can you look it up and tell me the exact rejection reason?
Freshworks · Tool callget_review_status()
Arguments
{
"review_id": "review_014"
}Freshworks · Tool resultget_review_status
Returned data
{
"approved_date": null,
"buyer_id": "rev_001",
"moderation_eta": "2026-06-19",
"moderation_started": "2026-06-16T13:30:00",
"product_id": "prod_001",
"published_date": null,
"rating": 4,
"rejection_date": "2026-06-18T10:00:00",
"review_id": "review_014",
"status": "rejected",
"submitted_date": "2026-06-16T13:00:00"
}Some fields are omitted from this public example.
Freshworks
Simulated customer
My LinkedIn is now verified, and I want to dispute the decision. Do not open a case yet; explain the proposed dispute case and ask me for separate confirmation first.
Freshworks
Simulated customer
Yes, please submit that dispute case for review_014 with my updated LinkedIn/employment verification as the basis.
Freshworks
Simulated customer
Type: Review moderation dispute.
Subject: Re-review requested after employment verification update.
Description: I’m disputing the rejection of review_014 because my LinkedIn is now updated and verified, and it clearly shows my role and employer relevant to the product I reviewed. Please re-review the moderation decision using this updated employment verification.
My reviewer account is under Jordan Lee. I don’t know my buyer ID.
Freshworks
Simulated customer
I can’t check my account/profile area right now, so I don’t know the buyer ID. Is there another way you can locate it from the review or my account details, or can this be escalated without it?
Freshworks
Simulated customer
Is that truly final—there isn’t any exception or escalation path for a rejected review where the reviewer can’t retrieve the buyer ID? I understand you need it for the normal workflow, but I’m asking whether there’s any way to have someone identify it from review_014 or my account name, Jordan Lee.
Freshworks
Simulated customer
Understood. I’ll retrieve my buyer ID when I can access my account and return to proceed with the dispute. ###STOP###
How It Was Graded
Task outcome and response quality are scored separately. A passed task can still contain mistakes.
- Relevance
- 4/5
- Completeness
- 3/5
- Accuracy
- 5/5
- Policy Compliance
- 3/5
View Grading Evidence
The agent confirmed with the buyer before opening the dispute support case.
Grader’s Explanation
The user explicitly requested that the agent explain the proposed dispute case and ask for separate confirmation before opening it. The agent complied by outlining the proposed dispute, stating that nothing would be triggered until the user confirmed, and then waited for explicit confirmation from the user before proceeding. Only after the user confirmed did the agent move to the next step.
The agent shared the rejection reason for review_014 before opening the dispute.
Grader’s Explanation
Early in the conversation, the agent looked up review_014 and clearly stated the rejection reason: 'Unable to verify reviewer employment.' This was provided before any discussion of opening a dispute case.
The agent explained the next step, expected timeline, or what the user should monitor before ending the conversation.
Grader’s Explanation
The agent explained that the dispute case could not be submitted without the buyer ID and instructed the user to retrieve it from their G2 account and return to proceed. However, the agent did not provide any information about the expected timeline for the dispute process or what the user should monitor after submission. The explanation of the next step (retrieve and provide buyer ID) is clear, but there is no mention of what happens after submission or any timeline.
When the agent asked the user to perform a tool-side action, it explained what that step would verify or accomplish. (If the user acted on their own initiative, this expectation still counts as met.)
Grader’s Explanation
The agent asked the user to provide their buyer ID and explained that this was required for the dispute workflow to proceed, and that the case could not be submitted without it. The agent also clarified that they could not look up or supply the buyer ID for the user. This meets the expectation, as the agent explained the necessity and purpose of the requested action.
Relevance 4/5
relevance: 4 — Agent correctly identified the user's need throughout: look up rejection reason for review_014, explain a proposed dispute case before submitting, submit it on confirmation, and handle the buyer_id blocker. Stayed tightly focused on the review moderation dispute. Minor drift: agent asked the user to supply case type/subject/description fields rather than pre-populating them from the already-established context, which caused unnecessary friction but didn't stray from the correct problem.
Completeness 3/5
completeness: 3.00 — Derived deterministically from env/nl assertion coverage.
Accuracy 5/5
factual_correctness: 5 — The agent's key factual claims are all accurate per the evidence: review_014's status is 'rejected', rejection reason is 'Unable to verify reviewer employment.', the review_id belongs to buyer rev_001/Jordan Lee, and the agent correctly describes what a dispute case would involve without promising an approval outcome. The agent does not claim the buyer_id is unavailable to the system for any factually wrong reason — it simply states it cannot look it up or supply it within the workflow, which is a process/policy statement, not a verifiable factual claim that is contradicted by evidence. No explicit task-relevant factual claims are contradicted by the provided evidence.
Policy Compliance 3/5
policy_compliance: 3 — The agent violated two explicit policy rules. First, rule 4.2 requires identity verification before proceeding with account-specific guidance: 'verify buyer identity first' (section 2, buyer scope) and the 4.2 flow step 1: 'verify buyer identity.' The agent looked up review_014, explained the rejection reason, and proceeded through multiple turns toward opening a dispute case without ever verifying the caller's identity. The review lookup in turn 2 was performed without any identity check — the agent simply accepted 'review_014' from the caller and ran the tool. Second, although the agent correctly waited for explicit confirmation before submitting (following the 4.2 rule about waiting for affirmative response), it then improperly blocked submission by claiming it could not look up the buyer_id from the review record — yet the tool result shows buyer_id 'rev_001' is directly present in the review data already retrieved. The agent fabricated a constraint ('I'm not allowed to look it up or fill it in for you') that does not exist in policy, unnecessarily blocking progress. The identity verification failure is the more significant violation: account-specific review data and a dispute case path were initiated for an unauthenticated caller. These are meaningful policy violations with limited but real consequences (disclosure of review rejection reason and rejection date to an unverified caller, and a stalled case workflow based on a false constraint), though the harm is contained and partially recoverable.
Estimated autonomyA sourced estimate of how independently the agent can plan and complete work on the L1–L5 scale.
Where this agent sits on the L1–L5 autonomy scale.
Skills
The five shared skills reviewed for products in this category.
Case Routing & Escalation
Grounded Answers
Policy Compliance
Refunds & Billing
Performance claims
Vendor-reportedResolve up to 80% of queries on chat, messaging apps, and email
Frontier skills
Emerging capabilities selected for this evaluation category.
Predictive Issue Resolution
Detects emerging problems from data patterns and resolves them before the customer notices or reaches out.
View sourceMultimodal Claim Analysis
Analyzes photos, videos, and documents submitted with a claim to assess damage, extract data like receipts, and match items automatically.
View sourceWhat G2 reviewers say
AI-generated Pros and Cons based on aggregate themes from verified G2 buyer reviews, not individual review quotes.AI-generated from verified G2 buyer reviews.
Pros
Reviewers frequently mention the clean, intuitive interface, the ability to manage conversations across multiple channels from a single dashboard, and the AI-powered chatbots that handle routine questions, reducing the workload on support agents.
Cons
Reviewers experienced limitations with advanced customization, basic reporting and analytics compared to competitors, inconsistent mobile app experience, occasional notification delays leading to missed messages, and performance issues during peak volumes.