<style>/*
<script async='async' crossorigin='anonymous' src='https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js?client=ca-pub-4277203702194282'></script>
<script async='async' custom-element='amp-auto-ads' src='https://cdn.ampproject.org/v0/amp-auto-ads-0.1.js'>
</script>
<script async='async' crossorigin='anonymous' src='https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js?client=ca-pub-4277203702194282'></script>
<script type='text/javascript'>
    (function(c,l,a,r,i,t,y){
        c[a]=c[a]||function(){(c[a].q=c[a].q||[]).push(arguments)};
        t=l.createElement(r);t.async=1;t.src="https://www.clarity.ms/tag/"+i;
        y=l.getElementsByTagName(r)[0];y.parentNode.insertBefore(t,y);
    })(window, document, "clarity", "script", "bzx0s5pb7a");
</script>
<meta content='u4bfbx5y1OtAQ96GA5P2KNUhjDUNO-nY8WbS37C8fY0' name='google-site-verification'/>
<script async='async' nonce='TYnVRAMVk-vZScbn1puaqQ' src='https://fundingchoicesmessages.google.com/i/pub-4277203702194282?ers=1'></script><script nonce='TYnVRAMVk-vZScbn1puaqQ'>(function() {function signalGooglefcPresent() {if (!window.frames['googlefcPresent']) {if (document.body) {const iframe = document.createElement('iframe'); iframe.style = 'width: 0; height: 0; border: none; z-index: -1000; left: -1000px; top: -1000px;'; iframe.style.display = 'none'; iframe.name = 'googlefcPresent'; document.body.appendChild(iframe);} else {setTimeout(signalGooglefcPresent, 0);}}}signalGooglefcPresent();})();</script>
<!-- Google Tag Manager -->
<script>(function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':
new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],
j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src=
'https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);
})(window,document,'script','dataLayer','GTM-MVLF66MV');</script>
<!-- End Google Tag Manager -->
<link href='https://www.blogger.com/dyn-css/authorization.css?targetBlogID=8805104366828178498&zx=cd652c80-91a1-4100-807b-a0322890d122' media='none' onload='if(media!='all')media='all'' rel='stylesheet'/><noscript><link href='https://www.blogger.com/dyn-css/authorization.css?targetBlogID=8805104366828178498&zx=cd652c80-91a1-4100-807b-a0322890d122' rel='stylesheet'/></noscript>
<meta name='google-adsense-platform-account' content='ca-host-pub-1556223355139109'/>
<meta name='google-adsense-platform-domain' content='blogspot.com'/>

<script async src="https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js?client=ca-pub-4277203702194282&host=ca-host-pub-1556223355139109" crossorigin="anonymous"></script>

<!-- data-ad-client=ca-pub-4277203702194282 -->

<script type="text/javascript" language="javascript">
  // Supply ads personalization default for EEA readers
  // See https://www.blogger.com/go/adspersonalization
  adsbygoogle = window.adsbygoogle || [];
  if (typeof adsbygoogle.requestNonPersonalizedAds === 'undefined') {
    adsbygoogle.requestNonPersonalizedAds = 1;
  }
</script>


</head>
<body>*/</style>

AI systems great at tests, but how do they perform in real life?

25 Aug, 2025

Traditional benchmarks for AI evaluation are limited in scope and can be manipulated.

source https://tech.hindustantimes.com/tech/news/ai-systems-great-at-tests-but-how-do-they-perform-in-real-life-71756119507856.html

Add Comment

Don't copy anything from my website!
Warning: Use of any material on this site is strictly prohibited and is a punishable offense under copyright law.

<style>/*<!--Es liegt in deiner Verantwortung, deine Besucher \xfcber die in deinem Blog verwendeten Cookies und die dort erfassten Daten zu informieren. Blogger stellt daf\xfcr eine Standardbenachrichtigung zur Verf\xfcgung, die du \xfcbernehmen, anpassen oder durch deine eigene Mitteilung ersetzen kannst. Weitere Informationen findest du unter http://www.blogger.com/go/cookiechoices.-->
<script defer='' src='/js/cookienotice.js'></script>
<script>
    document.addEventListener('DOMContentLoaded', function(event) {
      window.cookieChoices && cookieChoices.showCookieConsentBar && cookieChoices.showCookieConsentBar(
          (window.cookieOptions && cookieOptions.msg) || 'Diese Website verwendet Cookies von Google, um Dienste anzubieten und Zugriffe zu analysieren. Deine IP-Adresse und dein User-Agent werden zusammen mit Messwerten zur Leistung und Sicherheit f\xfcr Google freigegeben. So k\xf6nnen Nutzungsstatistiken generiert, Missbrauchsf\xe4lle erkannt und behoben und die Qualit\xe4t des Dienstes gew\xe4hrleistet werden.',
          (window.cookieOptions && cookieOptions.close) || 'Ok',
          (window.cookieOptions && cookieOptions.learn) || 'Weitere Informationen',
          (window.cookieOptions && cookieOptions.link) || 'https://www.blogger.com/go/blogspot-cookies');
    });
  </script>

<script type="text/javascript" src="https://www.blogger.com/static/v1/widgets/2112189061-widgets.js"></script>
<script type='text/javascript'>
window['__wavt'] = 'AOuZoY6AfuDYqmdWKL7XqPJpqueu-eQF5g:1756234419663';_WidgetManager._Init('//www.blogger.com/rearrange?blogID\x3d8805104366828178498','//blog.alaminshorkar.com/2025/08/ai-systems-great-at-tests-but-how-do.html','8805104366828178498');
_WidgetManager._SetDataContext([{'name': 'blog', 'data': {'blogId': '8805104366828178498', 'title': 'Blogs | Al-Amin Shorkar', 'url': 'https://blog.alaminshorkar.com/2025/08/ai-systems-great-at-tests-but-how-do.html', 'canonicalUrl': 'https://blog.alaminshorkar.com/2025/08/ai-systems-great-at-tests-but-how-do.html', 'homepageUrl': 'https://blog.alaminshorkar.com/', 'searchUrl': 'https://blog.alaminshorkar.com/search', 'canonicalHomepageUrl': 'https://blog.alaminshorkar.com/', 'blogspotFaviconUrl': 'https://blog.alaminshorkar.com/favicon.ico', 'bloggerUrl': 'https://www.blogger.com', 'hasCustomDomain': true, 'httpsEnabled': true, 'enabledCommentProfileImages': true, 'gPlusViewType': 'FILTERED_POSTMOD', 'adultContent': false, 'analyticsAccountNumber': 'UA-85228127-1', 'encoding': 'UTF-8', 'locale': 'en', 'localeUnderscoreDelimited': 'en', 'languageDirection': 'ltr', 'isPrivate': false, 'isMobile': false, 'isMobileRequest': false, 'mobileClass': '', 'isPrivateBlog': false, 'isDynamicViewsAvailable': true, 'feedLinks': '\x3clink rel\x3d\x22alternate\x22 type\x3d\x22application/atom+xml\x22 title\x3d\x22Blogs | Al-Amin Shorkar - Atom\x22 href\x3d\x22https://blog.alaminshorkar.com/feeds/posts/default\x22 /\x3e\n\x3clink rel\x3d\x22alternate\x22 type\x3d\x22application/rss+xml\x22 title\x3d\x22Blogs | Al-Amin Shorkar - RSS\x22 href\x3d\x22https://blog.alaminshorkar.com/feeds/posts/default?alt\x3drss\x22 /\x3e\n\x3clink rel\x3d\x22service.post\x22 type\x3d\x22application/atom+xml\x22 title\x3d\x22Blogs | Al-Amin Shorkar - Atom\x22 href\x3d\x22https://www.blogger.com/feeds/8805104366828178498/posts/default\x22 /\x3e\n\n\x3clink rel\x3d\x22alternate\x22 type\x3d\x22application/atom+xml\x22 title\x3d\x22Blogs | Al-Amin Shorkar - Atom\x22 href\x3d\x22https://blog.alaminshorkar.com/feeds/6346606523732899455/comments/default\x22 /\x3e\n', 'meTag': '', 'adsenseClientId': 'ca-pub-4277203702194282', 'adsenseHostId': 'ca-host-pub-1556223355139109', 'adsenseHasAds': true, 'adsenseAutoAds': true, 'boqCommentIframeForm': true, 'loginRedirectParam': '', 'view': '', 'dynamicViewsCommentsSrc': '//www.blogblog.com/dynamicviews/4224c15c4e7c9321/js/comments.js', 'dynamicViewsScriptSrc': '//www.blogblog.com/dynamicviews/ae6695f28f74b4f8', 'plusOneApiSrc': 'https://apis.google.com/js/platform.js', 'disableGComments': true, 'interstitialAccepted': false, 'sharing': {'platforms': [{'name': 'Get link', 'key': 'link', 'shareMessage': 'Get link', 'target': ''}, {'name': 'Facebook', 'key': 'facebook', 'shareMessage': 'Share to Facebook', 'target': 'facebook'}, {'name': 'BlogThis!', 'key': 'blogThis', 'shareMessage': 'BlogThis!', 'target': 'blog'}, {'name': 'X', 'key': 'twitter', 'shareMessage': 'Share to X', 'target': 'twitter'}, {'name': 'Pinterest', 'key': 'pinterest', 'shareMessage': 'Share to Pinterest', 'target': 'pinterest'}, {'name': 'Email', 'key': 'email', 'shareMessage': 'Email', 'target': 'email'}], 'disableGooglePlus': true, 'googlePlusShareButtonWidth': 0, 'googlePlusBootstrap': '\x3cscript type\x3d\x22text/javascript\x22\x3ewindow.___gcfg \x3d {\x27lang\x27: \x27en\x27};\x3c/script\x3e'}, 'hasCustomJumpLinkMessage': false, 'jumpLinkMessage': 'Read more', 'pageType': 'item', 'postId': '6346606523732899455', 'pageName': 'AI systems great at tests, but how do they perform in real life?', 'pageTitle': 'Blogs | Al-Amin Shorkar: AI systems great at tests, but how do they perform in real life?', 'metaDescription': ''}}, {'name': 'features', 'data': {}}, {'name': 'messages', 'data': {'edit': 'Edit', 'linkCopiedToClipboard': 'Link copied to clipboard!', 'ok': 'Ok', 'postLink': 'Post Link'}}, {'name': 'template', 'data': {'name': 'custom', 'localizedName': 'Custom', 'isResponsive': true, 'isAlternateRendering': false, 'isCustom': true}}, {'name': 'view', 'data': {'classic': {'name': 'classic', 'url': '?view\x3dclassic'}, 'flipcard': {'name': 'flipcard', 'url': '?view\x3dflipcard'}, 'magazine': {'name': 'magazine', 'url': '?view\x3dmagazine'}, 'mosaic': {'name': 'mosaic', 'url': '?view\x3dmosaic'}, 'sidebar': {'name': 'sidebar', 'url': '?view\x3dsidebar'}, 'snapshot': {'name': 'snapshot', 'url': '?view\x3dsnapshot'}, 'timeslide': {'name': 'timeslide', 'url': '?view\x3dtimeslide'}, 'isMobile': false, 'title': 'AI systems great at tests, but how do they perform in real life?', 'description': 'Technology \x26 Entertainment are the most important forces shaping our world. They are constantly evolving and changing the way we live, work and play.', 'url': 'https://blog.alaminshorkar.com/2025/08/ai-systems-great-at-tests-but-how-do.html', 'type': 'item', 'isSingleItem': true, 'isMultipleItems': false, 'isError': false, 'isPage': false, 'isPost': true, 'isHomepage': false, 'isArchive': false, 'isLabelSearch': false, 'postId': 6346606523732899455}}, {'name': 'widgets', 'data': [{'title': 'Upload Image', 'type': 'Image', 'sectionId': 'upload-image', 'id': 'Image10'}, {'title': 'Logo', 'type': 'HTML', 'sectionId': 'header-main', 'id': 'HTML10'}, {'title': 'Icons, Dark, Search', 'type': 'LinkList', 'sectionId': 'header-main', 'id': 'LinkList10'}, {'title': 'Menu', 'type': 'LinkList', 'sectionId': 'header-main', 'id': 'LinkList11'}, {'type': 'AdSense', 'sectionId': 'before-blog', 'id': 'AdSense2'}, {'title': 'Featured Blog', 'type': 'PopularPosts', 'sectionId': 'before-blog', 'id': 'PopularPosts1', 'posts': [{'title': 'Pakistan\x27s Sufiyan Muqeem Creates History, Becomes 1st Batter To...', 'id': 1772524108214822281}, {'title': '\x22Easy To Backstab When...\x22: Shreyas Iyer On PBKS\x27 Dressing Room Mentality After Sealing Top-2 Finish', 'id': 8350729903122205230}, {'title': 'New Zealand vs Pakistan 3rd ODI, LIVE Score Updates', 'id': 1043504286823755738}]}, {'type': 'AdSense', 'sectionId': 'before-blog', 'id': 'AdSense1'}, {'type': 'AdSense', 'sectionId': 'before-post', 'id': 'AdSense7'}, {'title': 'Blog Posts', 'type': 'Blog', 'sectionId': 'blog-post', 'id': 'Blog1', 'posts': [{'id': '6346606523732899455', 'title': 'AI systems great at tests, but how do they perform in real life?', 'showInlineAds': true}], 'footerBylines': [{'regionName': 'footer1', 'items': [{'name': 'timestamp', 'label': 'd MMM, yyyy'}, {'name': 'comments', 'label': 'Comment'}, {'name': 'icons', 'label': ''}, {'name': 'share', 'label': ''}]}, {'regionName': 'footer2', 'items': [{'name': 'labels', 'label': 'Labels :'}]}], 'allBylineItems': [{'name': 'timestamp', 'label': 'd MMM, yyyy'}, {'name': 'comments', 'label': 'Comment'}, {'name': 'icons', 'label': ''}, {'name': 'share', 'label': ''}, {'name': 'labels', 'label': 'Labels :'}]}, {'type': 'AdSense', 'sectionId': 'ads-post', 'id': 'AdSense14'}, {'type': 'AdSense', 'sectionId': 'ads-post', 'id': 'AdSense9'}, {'type': 'AdSense', 'sectionId': 'ads-post', 'id': 'AdSense3'}, {'title': '#You may also like', 'type': 'HTML', 'sectionId': 'ads-post', 'id': 'HTML15'}, {'type': 'AdSense', 'sectionId': 'after-blog', 'id': 'AdSense13'}, {'type': 'AdSense', 'sectionId': 'after-blog', 'id': 'AdSense4'}, {'type': 'AdSense', 'sectionId': 'sidebar-static', 'id': 'AdSense12'}, {'title': 'Popular Blogs', 'type': 'PopularPosts', 'sectionId': 'sidebar-static', 'id': 'PopularPosts10', 'posts': [{'title': 'Gboard adds \u2018Flick input sensitivity\u2019 setting, but it\u2019s not for swipe typing', 'id': 5872906888640674912}, {'title': 'Pakistan\x27s Sufiyan Muqeem Creates History, Becomes 1st Batter To...', 'id': 1772524108214822281}, {'title': 'New Zealand vs Pakistan 3rd ODI, LIVE Score Updates', 'id': 1043504286823755738}, {'title': 'Google Pixel 10 5G mobile series launched: Check out Price in India, specs, and features', 'id': 5303091537877709052}, {'title': 'Google Pixel 9 Pro gets  ?23,000 off on Flipkart hours before Pixel 10 Pro launch', 'id': 638770797175813295}]}, {'type': 'AdSense', 'sectionId': 'sidebar-static', 'id': 'AdSense5'}, {'title': 'Categories', 'type': 'Label', 'sectionId': 'sidebar-static', 'id': 'Label10'}, {'type': 'AdSense', 'sectionId': 'sidebar-static', 'id': 'AdSense11'}, {'type': 'AdSense', 'sectionId': 'sidebar-sticky', 'id': 'AdSense10'}, {'type': 'AdSense', 'sectionId': 'sidebar-sticky', 'id': 'AdSense6'}, {'title': 'About Us', 'type': 'HTML', 'sectionId': 'footer-widget 1', 'id': 'HTML21'}, {'title': 'Learn More', 'type': 'LinkList', 'sectionId': 'footer-widget 2', 'id': 'LinkList13'}, {'title': 'Important Link', 'type': 'LinkList', 'sectionId': 'footer-widget 3', 'id': 'LinkList1'}, {'title': 'Follow Us', 'type': 'LinkList', 'sectionId': 'footer-widget 4', 'id': 'LinkList14'}, {'title': 'Subscribe', 'type': 'HTML', 'sectionId': 'footer-widget 5', 'id': 'HTML22'}, {'title': 'Copyright', 'type': 'HTML', 'sectionId': 'copyright', 'id': 'HTML23'}, {'title': 'SVG Icons', 'type': 'HTML', 'sectionId': 'jet-options', 'id': 'HTML24'}]}]);
_WidgetManager._RegisterWidget('_ImageView', new _WidgetInfo('Image10', 'upload-image', document.getElementById('Image10'), {'resize': true}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_HTMLView', new _WidgetInfo('HTML10', 'header-main', document.getElementById('HTML10'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_LinkListView', new _WidgetInfo('LinkList10', 'header-main', document.getElementById('LinkList10'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_LinkListView', new _WidgetInfo('LinkList11', 'header-main', document.getElementById('LinkList11'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_AdSenseView', new _WidgetInfo('AdSense2', 'before-blog', document.getElementById('AdSense2'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_PopularPostsView', new _WidgetInfo('PopularPosts1', 'before-blog', document.getElementById('PopularPosts1'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_AdSenseView', new _WidgetInfo('AdSense1', 'before-blog', document.getElementById('AdSense1'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_AdSenseView', new _WidgetInfo('AdSense7', 'before-post', document.getElementById('AdSense7'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_BlogView', new _WidgetInfo('Blog1', 'blog-post', document.getElementById('Blog1'), {'cmtInteractionsEnabled': false, 'lightboxEnabled': true, 'lightboxModuleUrl': 'https://www.blogger.com/static/v1/jsbin/497930099-lbx.js', 'lightboxCssUrl': 'https://www.blogger.com/static/v1/v-css/123180807-lightbox_bundle.css'}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_AdSenseView', new _WidgetInfo('AdSense14', 'ads-post', document.getElementById('AdSense14'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_AdSenseView', new _WidgetInfo('AdSense9', 'ads-post', document.getElementById('AdSense9'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_AdSenseView', new _WidgetInfo('AdSense3', 'ads-post', document.getElementById('AdSense3'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_HTMLView', new _WidgetInfo('HTML15', 'ads-post', document.getElementById('HTML15'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_AdSenseView', new _WidgetInfo('AdSense13', 'after-blog', document.getElementById('AdSense13'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_AdSenseView', new _WidgetInfo('AdSense4', 'after-blog', document.getElementById('AdSense4'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_AdSenseView', new _WidgetInfo('AdSense12', 'sidebar-static', document.getElementById('AdSense12'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_PopularPostsView', new _WidgetInfo('PopularPosts10', 'sidebar-static', document.getElementById('PopularPosts10'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_AdSenseView', new _WidgetInfo('AdSense5', 'sidebar-static', document.getElementById('AdSense5'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_LabelView', new _WidgetInfo('Label10', 'sidebar-static', document.getElementById('Label10'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_AdSenseView', new _WidgetInfo('AdSense11', 'sidebar-static', document.getElementById('AdSense11'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_AdSenseView', new _WidgetInfo('AdSense10', 'sidebar-sticky', document.getElementById('AdSense10'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_AdSenseView', new _WidgetInfo('AdSense6', 'sidebar-sticky', document.getElementById('AdSense6'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_HTMLView', new _WidgetInfo('HTML21', 'footer-widget 1', document.getElementById('HTML21'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_LinkListView', new _WidgetInfo('LinkList13', 'footer-widget 2', document.getElementById('LinkList13'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_LinkListView', new _WidgetInfo('LinkList1', 'footer-widget 3', document.getElementById('LinkList1'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_LinkListView', new _WidgetInfo('LinkList14', 'footer-widget 4', document.getElementById('LinkList14'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_HTMLView', new _WidgetInfo('HTML22', 'footer-widget 5', document.getElementById('HTML22'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_HTMLView', new _WidgetInfo('HTML23', 'copyright', document.getElementById('HTML23'), {}, 'displayModeFull'));
_WidgetManager._RegisterWidget('_HTMLView', new _WidgetInfo('HTML24', 'jet-options', document.getElementById('HTML24'), {}, 'displayModeFull'));
</script>
</body>*/</style>

Popular Blogs

Gboard adds ‘Flick input sensitivity’ setting, but it’s not for swipe typing

Pakistan's Sufiyan Muqeem Creates History, Becomes 1st Batter To...

New Zealand vs Pakistan 3rd ODI, LIVE Score Updates

Google Pixel 10 5G mobile series launched: Check out Price in India, specs, and features

Google Pixel 9 Pro gets ?23,000 off on Flipkart hours before Pixel 10 Pro launch

Categories

About Us

Learn More

Important Link

Follow Us

Subscribe

Ad-Blocker Detected :((