Sber Sber Tier: Weak Russia access: Available

GigaChat Ultra

Verdict

Одна из лучших российских моделей с высоким общим баллом – уверенно справляется с планированием и аналитикой. Главная слабость – галлюцинации фактов и вставка фрагментов кода на Python в бизнес-ответы, что снижает доверие к выводам.

Overall rank
#28
Overall score
4.83/10
Cost per question
$10.00
per 1M tokens · ≈ 750 pages
Cost per answer
$10.00
per 1M tokens · ≈ 750 pages

Profile across 8 categories

0–10 scale. Higher means the model handled those tasks better

chart
Strong at
Planning
5.92/10
Weak at
Regional Awareness
3.98/10
Benchmark task – run and compare
Planning – 5.92/10

This is a real prompt from our benchmark. Hit "Run" – the model answers right here so you can compare with the competitor.

You
Я получаю 20-30 жалоб клиентов в неделю по электронной почте и через тикеты поддержки. Я приложил жалобы за 2 месяца (около 150 сообщений). Пожалуйста: 1. Проанализируй общий тренд настроений (становятся ли жалобы хуже?). 2. Выдели главные темы жалоб и их частоту. 3. Подсвети любые жалобы с высокой срочностью или риском эскалации. 4. Порекомендуй систему/структуру для отслеживания жалоб во времени. 5. Предложи, какие метрики мне стоит мониторить ежемесячно, чтобы выявлять возникающие проблемы на ранней стадии. === Customer Complaints - October 2025 (Month 1) === [Complaint #001 - Oct 2, 2025] Subject: Delayed shipment AGAIN Message: This is the third time my order has been delayed. I was promised delivery on Sept 28th, now it's Oct 2nd and still no package. Your customer service was helpful but this is getting ridiculous. [Complaint #002 - Oct 3, 2025] Subject: Widget X stopped working Message: I purchased Widget X two weeks ago and it just stopped functioning completely. No warning, just dead. Very disappointed with the quality. [Complaint #003 - Oct 5, 2025] Subject: Pricing confusion Message: Your website shows one price but I was charged $50 more at checkout. This feels like a bait-and-switch tactic. Please explain the discrepancy. [Complaint #004 - Oct 7, 2025] Subject: Shipping delay - order #4521 Message: My order was supposed to arrive last week for my daughter's birthday. It's still not here. She's devastated. This is unacceptable. [Complaint #005 - Oct 9, 2025] Subject: Widget X defective Message: Another Widget X failure! It worked for exactly 10 days then stopped. I'm seeing a pattern here. Is there a quality control issue? [Complaint #006 - Oct 11, 2025] Subject: Great support, but issue persists Message: Your support team was amazing and very helpful, but unfortunately the shipping delay problem continues. Not their fault, seems like a logistics issue. [Complaint #007 - Oct 13, 2025] Subject: Price increase without notice Message: I've been a loyal customer for 3 years. Why did prices go up 20% without any communication? This is disappointing. [Complaint #008 - Oct 15, 2025] Subject: Widget X - complete failure after 2 weeks Message: This is ridiculous. Widget X lasted exactly 14 days before failing completely. I need a full refund, not a replacement. [Complaint #009 - Oct 17, 2025] Subject: Delayed delivery affecting my business Message: I run a small business and rely on timely deliveries. This 2-week delay is costing me money and customers. Need better logistics. [Complaint #010 - Oct 19, 2025] Subject: Excellent customer service Message: While I'm frustrated with the product issue, your customer service team went above and beyond to help. Sarah was particularly helpful. [Complaint #011 - Oct 21, 2025] Subject: Widget X - safety concern Message: Widget X started smoking before it died. This could be a fire hazard! Very concerning. Needs urgent investigation. [Complaint #012 - Oct 23, 2025] Subject: Shipping takes forever Message: 3 weeks for standard shipping is not acceptable in 2025. Your competitors deliver in 3-5 days. [Complaint #013 - Oct 25, 2025] Subject: Price match policy unclear Message: Your website says you match competitor prices but when I tried to claim this, I was told it doesn't apply to my purchase. Confusing policy. [Complaint #014 - Oct 27, 2025] Subject: Widget X quality issues Message: I'm on my second Widget X unit. First one failed after 12 days, replacement looks like it's heading the same way. Manufacturing defect? [Complaint #015 - Oct 29, 2025] Subject: Shipping status not updated Message: Tracking shows my package hasn't moved in 5 days. Where is it? No response to my emails asking for update. === Customer Complaints - November 2025 (Month 2) === [Complaint #016 - Nov 2, 2025] Subject: URGENT - Widget X data loss Message: Widget X crashed and I lost all my project data. This is a CRITICAL issue. I need immediate support and data recovery assistance. [Complaint #017 - Nov 4, 2025] Subject: Prices actually went down! Message: I noticed you reduced prices recently. Thank you for listening to customer feedback. Much more reasonable now. [Complaint #018 - Nov 6, 2025] Subject: Another Widget X failure - 15 days Message: Widget X lasted 15 days this time. There's clearly a systemic quality problem. How are you addressing this? [Complaint #019 - Nov 8, 2025] Subject: Shipping delay for holiday gift Message: Ordered a gift 3 weeks before the holiday, still hasn't arrived. This is ruining my holiday plans. [Complaint #020 - Nov 10, 2025] Subject: Widget X - third failure Message: Third Widget X unit has failed. All within 2 weeks of purchase. I'm done. Full refund please. [Complaint #021 - Nov 12, 2025] Subject: Support team was fantastic Message: Despite my product issues, your support team (especially Mike) was incredibly helpful and patient. Great people. [Complaint #022 - Nov 14, 2025] Subject: Appreciate the price reduction Message: The recent price cut makes your products much more competitive. Thank you for listening to customers. [Complaint #023 - Nov 16, 2025] Subject: Widget X smoking - DANGER Message: Widget X started smoking and smells like burning plastic. This is a SAFETY HAZARD. You need to recall these units immediately. [Complaint #024 - Nov 18, 2025] Subject: Shipping still slow but improving Message: Delivery took 10 days this time, down from 3 weeks last month. Still not great but heading in the right direction. [Complaint #025 - Nov 20, 2025] Subject: Widget X - battery issue? Message: Widget X seems to have a battery problem. It overheats and dies within 2 weeks. Are you investigating this? [Complaint #026 - Nov 22, 2025] Subject: Good customer service experience Message: Filed a complaint about delayed shipping. Support team resolved it quickly and professionally. Thank you. [Complaint #027 - Nov 24, 2025] Subject: Widget X failure pattern Message: I've tracked Widget X complaints online. Everyone reports failure between days 10-15. Manufacturing defect is obvious now. [Complaint #028 - Nov 26, 2025] Subject: Prices are now fair Message: The new pricing is much better. I'm willing to buy again now that it's competitive with alternatives. [Complaint #029 - Nov 28, 2025] Subject: Shipping delays persist Message: Still waiting 2+ weeks for deliveries. This hasn't improved much despite earlier promises. [Complaint #030 - Nov 30, 2025] Subject: Widget X - complete disaster Message: This product is dangerous and unreliable. I'm considering legal action if you don't issue a recall.
Comparing:
GigaChat-Ultra · GigaChat-2-Max

Same model – two results

experiment, 1,700 runs
Typical prompt

Нужно составить OKR на следующий квартал. Выручка: Q1 12 млн, Q2 14 млн, Q3 11 млн. Команда 8 человек. Конкурент дешевле на 20%.

7.0 /10
Structured prompt

...Формат:

  • § Анализ данных (тренд, ресурсы, угроза)
  • § OKR с таблицей Key Results (метрика + целевое + текущее)
  • § Что НЕ вошло и почему
  • § Ограничения
8.8 /10 +25%

Without a template the model sets abstract goals. With one – ties OKRs to real numbers and constraints.

About this experiment →

Category breakdown

Russia availability

Direct access

Related articles

You chose a model for planning

Now it's about the prompt. The Project Management with AI module has templates for OKRs, roadmaps, retros, and pre-mortems. One prompt template improves quality by 25%.

See the templates →