{"id":5669,"date":"2021-02-17T01:05:00","date_gmt":"2021-02-16T16:05:00","guid":{"rendered":"https:\/\/t.motd.kr\/?p=5669"},"modified":"2022-12-28T01:44:31","modified_gmt":"2022-12-27T16:44:31","slug":"paths-crossed-again","status":"publish","type":"post","link":"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/","title":{"rendered":"Paths crossed again"},"content":{"rendered":"\n

A Korean proverb many Koreans like myself often forget is:<\/p>\n\n\n\n

\uc637\uae43\ub9cc \uc2a4\uccd0\ub3c4 \uc778\uc5f0<\/p>Merely brushing by someone means you\u2019re fatefully connected to that person.<\/em><\/cite><\/blockquote><\/figure>\n\n\n\n

So many social connections come and go through our lives, and we don\u2019t always value them as much as they deserve. But so much can happen even with brief interactions, which is what I\u2019m going to unfold in this post.<\/p>\n\n\n\n

In 2014, I was having busy days as a lead of the Netty project<\/a>. Like any moderately popular open-source project, its maintenance is often a race against your inbox. Overwhelmed by an abundance of questions and feature requests, it\u2019s easy to focus too much on achieving \u2018inbox zero\u2019 and forget about the milestones users are trying to achieve with the project.<\/p>\n\n\n\n

Apache Spark\u2122 was one such user, and that was my first brush with Reynold Xin<\/a>, Databricks\u2019 Co-founder. Norman (another Netty maintainer) and I helped him with a<\/a> few<\/a> interesting<\/a> issues<\/a> related to zero-copy file transfer and \/dev\/epoll transport. We didn\u2019t even know what project Reynold was working on at that time. A few months later, we finally learned from Reynold\u2019s email<\/a> about Apache Spark\u2019s winning at 2014 Gray Sort competition<\/a> that Netty played a non-trivial role. It was a very pleasant surprise, and I was excited that Netty could make an impact in many different areas.<\/p>\n\n\n\n

Exciting moments are fleeting and the life of an open-source project maintainer continues. We, maybe Reynold, too, all forgot about this milestone and moved on to the next pile of issues in an issue tracker.<\/p>\n\n\n\n

Fast forward \u2014 my focus moved from pure network programming to frameworks that help organizations scale by providing smooth migration paths to asynchronous and reactive programming models. Armeria<\/a> was the open-source RPC\/REST framework my team designed from scratch for this purpose. In the last few years, thanks to Armeria, I had the opportunity to help users from various companies who were facing similar migration challenges.<\/p>\n\n\n\n

In its essence, the journey with Armeria was not largely different from what I had with Netty. I was thrilled by our happy users and the pleasant surprises they gave us. At the same time, it was a race against an endless stream of issues and pull requests to address and review. We shipped more than 170 releases with 2,500 commits for 5 years. It was a great achievement, but it also made me crave something new to work on that would broaden my horizon.<\/p>\n\n\n\n

That was when my and Databricks\u2019 paths crossed again.<\/p>\n\n\n\n

Earlier this year, the Databricks engineering team was designing a new communication protocol for the recently announced SQL Analytics<\/a> product. As part of the researching solutions for a scalability issue, they found Armeria. The team reached out to me explaining the challenges they had with sending massive amounts of data across the network, with the goal to optimize for both higher throughput and lower latency. A series of interesting technical discussions led to Reynold asking whether I\u2019d consider joining Databricks.<\/p>\n\n\n\n

I must confess that, after all those years, I had no idea what Databricks does! Actually, I couldn\u2019t even remember the name of the company. After brief research about the company, I was even less sure whether Databricks would be the right place for me given my lack of experience in data or machine learning. I decided to talk to the team more since the technical interactions were interesting (sorting petabytes of data and protocol optimizations).<\/p>\n\n\n\n

However, my impression of the company changed dramatically as I went through the interview process. The interviews were more like bidirectional technical discussions, even when I was solving a given problem. I was impressed that I was not treated as a student to fill in the blanks but as a partner with the same goal. All in all, the interviewers were very friendly, and I was able to express my ideas interactively with great comfort. Such an attitude does not come from a recruiting manual. It was a clear sign that Databricks is a healthy place built on top of good faith and curiosity.<\/p>\n\n\n\n

What fascinated me was the engineers\u2019 telltale excitement at every moment: when explaining what they\u2019ve built, showing some growth charts, and confessing the challenges ahead\u2013or even some technical debt. At the end of the interview day, I started to think Databricks may be a place worth betting my career on.<\/p>\n\n\n\n

As you can guess, the rest is history \u2013 well, in progress. As part of our engineering team, I focus on our RPC stack to help scale the organization and optimize our software fleet of millions of machines. The three short months here reinforce the choice I made. I love the technical challenges, in-depth design review process, investment in new technologies, and heavy leverage of automation I found here. I also enjoy the impact I have had already, and will have, on the future, with the great culture and learnings from the rest of the team.<\/p>\n\n\n\n

Looking back, I\u2019m amazed at how such a brief cross-continental collaboration led us here \u2013 even after many years. It is indeed a magical journey that leaves a lot to be discovered and remembered.<\/p>\n\n\n\n

(This post originally appeared at Databricks company blog<\/a>.)<\/p>\n","protected":false},"excerpt":{"rendered":"

A Korean proverb many Koreans like myself often forget is: \uc637\uae43\ub9cc \uc2a4\uccd0\ub3c4 \uc778\uc5f0 Merely brushing by someone means you\u2019re fatefully connected to that person. So many social connections come and go through our lives, and we don\u2019t always value them as much as they deserve. But so much can happen even with brief interactions, which… Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"yoast_head":"Paths crossed again — T's message of the day<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Paths crossed again — T's message of the day\" \/>\n<meta property=\"og:description\" content=\"A Korean proverb many Koreans like myself often forget is: \uc637\uae43\ub9cc \uc2a4\uccd0\ub3c4 \uc778\uc5f0 Merely brushing by someone means you\u2019re fatefully connected to that person. So many social connections come and go through our lives, and we don\u2019t always value them as much as they deserve. But so much can happen even with brief interactions, which... Continue reading →\" \/>\n<meta property=\"og:url\" content=\"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/\" \/>\n<meta property=\"og:site_name\" content=\"T's message of the day\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/trustin\" \/>\n<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/trustin\" \/>\n<meta property=\"article:published_time\" content=\"2021-02-16T16:05:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-12-27T16:44:31+00:00\" \/>\n<meta name=\"author\" content=\"Trustin Lee\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@https:\/\/www.twitter.com\/trustin\" \/>\n<meta name=\"twitter:site\" content=\"@trustin\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Trustin Lee\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/\"},\"author\":{\"name\":\"Trustin Lee\",\"@id\":\"https:\/\/vault.motd.kr\/wordpress\/#\/schema\/person\/4430ad90fc2ddeef051565701d85db9d\"},\"headline\":\"Paths crossed again\",\"datePublished\":\"2021-02-16T16:05:00+00:00\",\"dateModified\":\"2022-12-27T16:44:31+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/\"},\"wordCount\":869,\"publisher\":{\"@id\":\"https:\/\/vault.motd.kr\/wordpress\/#\/schema\/person\/4430ad90fc2ddeef051565701d85db9d\"},\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/\",\"url\":\"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/\",\"name\":\"Paths crossed again — T's message of the day\",\"isPartOf\":{\"@id\":\"https:\/\/vault.motd.kr\/wordpress\/#website\"},\"datePublished\":\"2021-02-16T16:05:00+00:00\",\"dateModified\":\"2022-12-27T16:44:31+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/vault.motd.kr\/wordpress\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Paths crossed again\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/vault.motd.kr\/wordpress\/#website\",\"url\":\"https:\/\/vault.motd.kr\/wordpress\/\",\"name\":\"T's message of the day\",\"description\":\"the best is yet to come\",\"publisher\":{\"@id\":\"https:\/\/vault.motd.kr\/wordpress\/#\/schema\/person\/4430ad90fc2ddeef051565701d85db9d\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/vault.motd.kr\/wordpress\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\/\/vault.motd.kr\/wordpress\/#\/schema\/person\/4430ad90fc2ddeef051565701d85db9d\",\"name\":\"Trustin Lee\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vault.motd.kr\/wordpress\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/vault.motd.kr\/wordpress\/wp-content\/uploads\/2020\/09\/avatar-2019-966px.png\",\"contentUrl\":\"https:\/\/vault.motd.kr\/wordpress\/wp-content\/uploads\/2020\/09\/avatar-2019-966px.png\",\"width\":966,\"height\":966,\"caption\":\"Trustin Lee\"},\"logo\":{\"@id\":\"https:\/\/vault.motd.kr\/wordpress\/#\/schema\/person\/image\/\"},\"sameAs\":[\"https:\/\/t.motd.kr\/\",\"https:\/\/www.facebook.com\/trustin\",\"https:\/\/www.instagram.com\/trustinlee\/\",\"https:\/\/www.linkedin.com\/in\/trustin\",\"https:\/\/twitter.com\/https:\/\/www.twitter.com\/trustin\",\"https:\/\/www.youtube.com\/@trustinlee\"]}]}<\/script>","yoast_head_json":{"title":"Paths crossed again — T's message of the day","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/","og_locale":"en_US","og_type":"article","og_title":"Paths crossed again — T's message of the day","og_description":"A Korean proverb many Koreans like myself often forget is: \uc637\uae43\ub9cc \uc2a4\uccd0\ub3c4 \uc778\uc5f0 Merely brushing by someone means you\u2019re fatefully connected to that person. So many social connections come and go through our lives, and we don\u2019t always value them as much as they deserve. But so much can happen even with brief interactions, which... Continue reading →","og_url":"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/","og_site_name":"T's message of the day","article_publisher":"https:\/\/www.facebook.com\/trustin","article_author":"https:\/\/www.facebook.com\/trustin","article_published_time":"2021-02-16T16:05:00+00:00","article_modified_time":"2022-12-27T16:44:31+00:00","author":"Trustin Lee","twitter_card":"summary_large_image","twitter_creator":"@https:\/\/www.twitter.com\/trustin","twitter_site":"@trustin","twitter_misc":{"Written by":"Trustin Lee","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/#article","isPartOf":{"@id":"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/"},"author":{"name":"Trustin Lee","@id":"https:\/\/vault.motd.kr\/wordpress\/#\/schema\/person\/4430ad90fc2ddeef051565701d85db9d"},"headline":"Paths crossed again","datePublished":"2021-02-16T16:05:00+00:00","dateModified":"2022-12-27T16:44:31+00:00","mainEntityOfPage":{"@id":"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/"},"wordCount":869,"publisher":{"@id":"https:\/\/vault.motd.kr\/wordpress\/#\/schema\/person\/4430ad90fc2ddeef051565701d85db9d"},"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/","url":"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/","name":"Paths crossed again — T's message of the day","isPartOf":{"@id":"https:\/\/vault.motd.kr\/wordpress\/#website"},"datePublished":"2021-02-16T16:05:00+00:00","dateModified":"2022-12-27T16:44:31+00:00","breadcrumb":{"@id":"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/vault.motd.kr\/wordpress\/posts\/5669\/paths-crossed-again\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/vault.motd.kr\/wordpress\/"},{"@type":"ListItem","position":2,"name":"Paths crossed again"}]},{"@type":"WebSite","@id":"https:\/\/vault.motd.kr\/wordpress\/#website","url":"https:\/\/vault.motd.kr\/wordpress\/","name":"T's message of the day","description":"the best is yet to come","publisher":{"@id":"https:\/\/vault.motd.kr\/wordpress\/#\/schema\/person\/4430ad90fc2ddeef051565701d85db9d"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/vault.motd.kr\/wordpress\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":["Person","Organization"],"@id":"https:\/\/vault.motd.kr\/wordpress\/#\/schema\/person\/4430ad90fc2ddeef051565701d85db9d","name":"Trustin Lee","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vault.motd.kr\/wordpress\/#\/schema\/person\/image\/","url":"https:\/\/vault.motd.kr\/wordpress\/wp-content\/uploads\/2020\/09\/avatar-2019-966px.png","contentUrl":"https:\/\/vault.motd.kr\/wordpress\/wp-content\/uploads\/2020\/09\/avatar-2019-966px.png","width":966,"height":966,"caption":"Trustin Lee"},"logo":{"@id":"https:\/\/vault.motd.kr\/wordpress\/#\/schema\/person\/image\/"},"sameAs":["https:\/\/t.motd.kr\/","https:\/\/www.facebook.com\/trustin","https:\/\/www.instagram.com\/trustinlee\/","https:\/\/www.linkedin.com\/in\/trustin","https:\/\/twitter.com\/https:\/\/www.twitter.com\/trustin","https:\/\/www.youtube.com\/@trustinlee"]}]}},"_links":{"self":[{"href":"https:\/\/vault.motd.kr\/wordpress\/wp-json\/wp\/v2\/posts\/5669"}],"collection":[{"href":"https:\/\/vault.motd.kr\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/vault.motd.kr\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/vault.motd.kr\/wordpress\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/vault.motd.kr\/wordpress\/wp-json\/wp\/v2\/comments?post=5669"}],"version-history":[{"count":1,"href":"https:\/\/vault.motd.kr\/wordpress\/wp-json\/wp\/v2\/posts\/5669\/revisions"}],"predecessor-version":[{"id":5693,"href":"https:\/\/vault.motd.kr\/wordpress\/wp-json\/wp\/v2\/posts\/5669\/revisions\/5693"}],"wp:attachment":[{"href":"https:\/\/vault.motd.kr\/wordpress\/wp-json\/wp\/v2\/media?parent=5669"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/vault.motd.kr\/wordpress\/wp-json\/wp\/v2\/categories?post=5669"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/vault.motd.kr\/wordpress\/wp-json\/wp\/v2\/tags?post=5669"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}