| Task | Useful workflow to evaluate | What still needs review |
|---|
| Writing | Supply the source material, audience and requested revision; inspect the returned draft against the source | Unsupported facts, changed meaning and invented quotations |
| Coding | Work from a defined codebase or example and a concrete change request | Dependencies, permissions and tests in the intended environment |
| Research | Keep related uploaded files and instructions in a Project, then ask a bounded question | Whether the cited material actually supports each important conclusion |
Official Projects documentation describes shared files, instructions and related chats; a project does not automatically provide access to an arbitrary folder on your computer. These jobs can suit iterative work, but none establishes that ChatGPT outperforms another assistant or that a generated program works without checking.
For a bounded household task, use the web interface and the plan actually shown in your account. A text-only brief avoids assuming a file-upload allowance: ask for three dinners for two adults, list permitted ingredients with quantities and units, and request one shopping list. For example:
"Plan three dinners for two adults using the ingredient list below. Keep each meal's ingredient quantities explicit. Group shopping quantities only when the ingredient and unit match. Ask about missing amounts instead of inventing them. Then replace dinner two while keeping dinners one and three unchanged."
Supply the ingredient list after the brief. Compare the first and revised drafts: the selected meal should change, the other meals should stay intact, and shared shopping quantities should reflect the revision. If the list is inconsistent, identify the affected ingredient and ask for a correction; retain a checked text list if a generated file or interface cannot preserve the change. Review ingredient suitability yourself. The three-dinner brief above is a proposed follow-up; the narrower two-dinner web test below was completed.
A two-turn meal plan tested in a temporary chat
An AI agent opened a temporary ChatGPT web chat and supplied fictional inventory for two dinners for two people: 4 eggs, 2 cups of uncooked rice, 1 can of beans and 2 carrots. We asked it to allocate every item, show each day's amounts and verify the total without inventing a can size. It split the inventory evenly: each day had 2 eggs, 1 cup rice, half a can of beans and 1 carrot. Its check table showed zero leftovers.
In the next prompt we made Day 2 egg-free while requiring Day 1 and its amounts to stay unchanged. The revised table kept Day 1 at 2 eggs, 1 cup rice, half a can of beans and 1 carrot; it assigned Day 2 no eggs and left the other three Day 2 amounts unchanged. The new inventory check showed 2 of 4 eggs used and 2 left over, with zero rice, bean or carrot leftovers. It explicitly said that using every original ingredient was now impossible under the new constraints. We checked those four totals against the prompts and the first table.
This is evidence that the visible chat handled one constrained text revision and identified the conflict in that case. It does not measure recipe quality, food safety, nutrition, Projects, file persistence or a shopping-list app. The same ingredient bowls on both days also show why a balanced quantity table is not by itself a useful or varied dinner plan. Test those concerns separately before relying on the result.
A measured limit for news-source lookup
The
Tow Center's 2025 test asked ChatGPT Search to identify specific news articles from supplied excerpts. It identified
134 of 200 articles incorrectly and flagged uncertainty in only
15 of 200 responses. The researchers tested article retrieval and citation, not drafting quality, coding or every current ChatGPT model. For research work, a plausible answer or attached link is therefore a starting point: open the cited article, check that its title and passage match the claim, and record the original publisher. We did not repeat the Tow Center's test. Our separate temporary-chat task checked meal allocation, not news citation accuracy.