{"id":211745,"date":"2019-02-27T17:19:58","date_gmt":"2019-02-27T11:49:58","guid":{"rendered":"https:\/\/zerodha.com\/z-connect\/?p=211745"},"modified":"2024-02-02T14:39:14","modified_gmt":"2024-02-02T09:09:14","slug":"todays-technical-issues-postmortem","status":"publish","type":"post","link":"https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem","title":{"rendered":"Today&#8217;s technical issues &#8211; postmortem"},"content":{"rendered":"<p>Dear Traders,<\/p>\n<p>We are extremely sorry about the issues that you faced today morning on our trading platforms. We have identified what caused today&#8217;s issue and hopefully should not repeat going forward. Let me explain what went down today.<\/p>\n<p>At the market opening, especially between 9.14 to 9.20 we have an exceptional amount of activity in terms of logins and order placement. The connectivity between our trading platforms and the exchanges, the bridge, is managed by Thomson Reuters&#8217; Omnesys, an exchange approved OMS (Order Management System) vendor. Thomson Reuters is the largest OMS vendors in India powering several dozen brokers. Almost all brokerages use OMS vendor to power their platforms, albeit at a much smaller scale &#8211; both in terms of orders and number of users.<\/p>\n<p>Today at the market open, the OMS developed connectivity issues, which resulted in orders piling up. We witnessed several lakh orders piled up waiting to be pushed to the exchanges. This would&#8217;ve been indicated by the &#8220;validation pending&#8221; status you would have seen. This caused a snowball effect of customers placing more orders to make up for the hanging orders, increasing the pile up exponentially.\u00a0The Thomson Reuters team tried to bring the pending order queue down, but it wouldn&#8217;t happen. Since the OMS is their proprietary system that is licensed out to stock brokers, our technology team does not have any control over the internals of the system. We were in constant touch with several of their teams trying to get a resolution.<\/p>\n<p>This is not the first time such issues have happened, and over the years, we&#8217;ve built more and more layers of technology in-house to reduce the dependency on the OMS and other similar systems. In fact, as of today, over 90% of the activity load half a million of our concurrent clients produce every day is handled by our systems efficiently, but the rest of the 10% that still goes to the OMS sometimes acts as the weakest link. Thomson Reuters&#8217; OMS, despite being one of the best in the industry, has struggled to cope with our growth.<\/p>\n<p>Of course, this isn&#8217;t us avoiding taking responsibility for what happened today or other incidents in the past. We are your brokerage firm and we are responsible for the services delivered to you irrespective of what happens in the background. But we do not want you to cast doubts on the technology we&#8217;ve built, and the immense amount of effort and resources, we&#8217;ve invested to bring you the platforms you use every day.<\/p>\n<p>The toughest decision to take as a business at our scale is to change or not. Because every change comes with a business continuity risk.\u00a0 It is very easy to stop taking that risk and be happy with the product offering and wait for years to make small changes. But that is not how we have envisaged the business we are building for you. We want to be the best brokerage firm you can have, and we hope that you will excuse us when we slip-up, and be rest assured that the most important thing we are working on 24\/7 is to avoid any downtime during trading hours.<\/p>\n<p>Again, we are extremely sorry.<\/p>\n<p>Regards,<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Dear Traders, We are extremely sorry about the issues that you faced today morning on our trading platforms. We have identified what caused today&#8217;s issue and hopefully should not repeat going forward. Let me explain what went down today. At the market opening, especially between 9.14 to 9.20 we have an exceptional amount of activity [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[531],"tags":[],"class_list":["post-211745","post","type-post","status-publish","format-standard","hentry","category-general"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v23.5 (Yoast SEO v26.6) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Today&#039;s technical issues - postmortem &#8211; Z-Connect by Zerodha<\/title>\n<meta name=\"description\" content=\"Dear Traders, We are extremely sorry about the issues that you faced today morning on our trading platforms. We have identified what caused today&#039;s issue\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Today&#039;s technical issues - postmortem\" \/>\n<meta property=\"og:description\" content=\"Dear Traders, We are extremely sorry about the issues that you faced today morning on our trading platforms. We have identified what caused today&#039;s issue\" \/>\n<meta property=\"og:url\" content=\"https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem\" \/>\n<meta property=\"og:site_name\" content=\"Z-Connect by Zerodha\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/zerodha.social\" \/>\n<meta property=\"article:published_time\" content=\"2019-02-27T11:49:58+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-02-02T09:09:14+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/zerodha.com\/z-connect\/wp-content\/uploads\/2024\/02\/thumb.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"675\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Nithin Kamath\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@nithin0dha\" \/>\n<meta name=\"twitter:site\" content=\"@zerodhaonline\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Nithin Kamath\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem\",\"url\":\"https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem\",\"name\":\"Today's technical issues - postmortem &#8211; Z-Connect by Zerodha\",\"isPartOf\":{\"@id\":\"https:\/\/zerodha.com\/z-connect\/#website\"},\"datePublished\":\"2019-02-27T11:49:58+00:00\",\"dateModified\":\"2024-02-02T09:09:14+00:00\",\"author\":{\"@id\":\"https:\/\/zerodha.com\/z-connect\/#\/schema\/person\/03de5b6b47eb838a0067a9d11a1ffaf6\"},\"description\":\"Dear Traders, We are extremely sorry about the issues that you faced today morning on our trading platforms. We have identified what caused today's issue\",\"breadcrumb\":{\"@id\":\"https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/zerodha.com\/z-connect\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"General\",\"item\":\"https:\/\/zerodha.com\/z-connect\/category\/general\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Today&#8217;s technical issues &#8211; postmortem\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/zerodha.com\/z-connect\/#website\",\"url\":\"https:\/\/zerodha.com\/z-connect\/\",\"name\":\"Zerodha product and business updates\",\"description\":\"Z-Connect is Zerodha&#039;s official blog. Get the latest updates, product announcements news, and insights all in one place.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/zerodha.com\/z-connect\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/zerodha.com\/z-connect\/#\/schema\/person\/03de5b6b47eb838a0067a9d11a1ffaf6\",\"name\":\"Nithin Kamath\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/zerodha.com\/z-connect\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/zerodha.com\/z-connect\/wp-content\/uploads\/2019\/05\/unnamed-1-96x96.jpg\",\"contentUrl\":\"https:\/\/zerodha.com\/z-connect\/wp-content\/uploads\/2019\/05\/unnamed-1-96x96.jpg\",\"caption\":\"Nithin Kamath\"},\"description\":\"Founder &amp; CEO @ Zerodha\",\"sameAs\":[\"https:\/\/nithinkamath.me\",\"https:\/\/x.com\/nithin0dha\"],\"url\":\"https:\/\/zerodha.com\/z-connect\/author\/nithin-kamath\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Today's technical issues - postmortem &#8211; Z-Connect by Zerodha","description":"Dear Traders, We are extremely sorry about the issues that you faced today morning on our trading platforms. We have identified what caused today's issue","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem","og_locale":"en_US","og_type":"article","og_title":"Today's technical issues - postmortem","og_description":"Dear Traders, We are extremely sorry about the issues that you faced today morning on our trading platforms. We have identified what caused today's issue","og_url":"https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem","og_site_name":"Z-Connect by Zerodha","article_publisher":"https:\/\/www.facebook.com\/zerodha.social","article_published_time":"2019-02-27T11:49:58+00:00","article_modified_time":"2024-02-02T09:09:14+00:00","og_image":[{"width":1200,"height":675,"url":"https:\/\/zerodha.com\/z-connect\/wp-content\/uploads\/2024\/02\/thumb.png","type":"image\/png"}],"author":"Nithin Kamath","twitter_card":"summary_large_image","twitter_creator":"@nithin0dha","twitter_site":"@zerodhaonline","twitter_misc":{"Written by":"Nithin Kamath","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem","url":"https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem","name":"Today's technical issues - postmortem &#8211; Z-Connect by Zerodha","isPartOf":{"@id":"https:\/\/zerodha.com\/z-connect\/#website"},"datePublished":"2019-02-27T11:49:58+00:00","dateModified":"2024-02-02T09:09:14+00:00","author":{"@id":"https:\/\/zerodha.com\/z-connect\/#\/schema\/person\/03de5b6b47eb838a0067a9d11a1ffaf6"},"description":"Dear Traders, We are extremely sorry about the issues that you faced today morning on our trading platforms. We have identified what caused today's issue","breadcrumb":{"@id":"https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/zerodha.com\/z-connect\/general\/todays-technical-issues-postmortem#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/zerodha.com\/z-connect\/"},{"@type":"ListItem","position":2,"name":"General","item":"https:\/\/zerodha.com\/z-connect\/category\/general"},{"@type":"ListItem","position":3,"name":"Today&#8217;s technical issues &#8211; postmortem"}]},{"@type":"WebSite","@id":"https:\/\/zerodha.com\/z-connect\/#website","url":"https:\/\/zerodha.com\/z-connect\/","name":"Zerodha product and business updates","description":"Z-Connect is Zerodha&#039;s official blog. Get the latest updates, product announcements news, and insights all in one place.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/zerodha.com\/z-connect\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/zerodha.com\/z-connect\/#\/schema\/person\/03de5b6b47eb838a0067a9d11a1ffaf6","name":"Nithin Kamath","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/zerodha.com\/z-connect\/#\/schema\/person\/image\/","url":"https:\/\/zerodha.com\/z-connect\/wp-content\/uploads\/2019\/05\/unnamed-1-96x96.jpg","contentUrl":"https:\/\/zerodha.com\/z-connect\/wp-content\/uploads\/2019\/05\/unnamed-1-96x96.jpg","caption":"Nithin Kamath"},"description":"Founder &amp; CEO @ Zerodha","sameAs":["https:\/\/nithinkamath.me","https:\/\/x.com\/nithin0dha"],"url":"https:\/\/zerodha.com\/z-connect\/author\/nithin-kamath"}]}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/zerodha.com\/z-connect\/wp-json\/wp\/v2\/posts\/211745","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/zerodha.com\/z-connect\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/zerodha.com\/z-connect\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/zerodha.com\/z-connect\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/zerodha.com\/z-connect\/wp-json\/wp\/v2\/comments?post=211745"}],"version-history":[{"count":10,"href":"https:\/\/zerodha.com\/z-connect\/wp-json\/wp\/v2\/posts\/211745\/revisions"}],"predecessor-version":[{"id":211793,"href":"https:\/\/zerodha.com\/z-connect\/wp-json\/wp\/v2\/posts\/211745\/revisions\/211793"}],"wp:attachment":[{"href":"https:\/\/zerodha.com\/z-connect\/wp-json\/wp\/v2\/media?parent=211745"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/zerodha.com\/z-connect\/wp-json\/wp\/v2\/categories?post=211745"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/zerodha.com\/z-connect\/wp-json\/wp\/v2\/tags?post=211745"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}