Venice

This week we are presenting our paper "LiNR: Model Based Neural Retrieval on GPUs at LinkedIn" accepted at CIKM 2024 (https://lnkd.in/gUrWqRcD). Please stop by and say hi to Aman Gupta, who will be there in person :) We discuss our experiences and challenges in creating scalable, differentiable search indexes using TensorFlow and PyTorch at production scale. In LiNR, both items and model weights are integrated into the model binary. Viewing index construction as a form of model training, we describe scaling our system for large indexes, incorporating full scans and efficient filtering. We believe LiNR represents one of the industry's first Live-updated model-based retrieval indexes at production scale. Talented co-authors include Fedor Borisyuk, Qingquan Song, Mingzhou Zhou, Ganesh Parameswaran, Madhulekha Arun, Siva P., Tugrul Bingol, Zhoutao Pei, Stanley(Kuang) Lee, Lu Z., Hugh Shao, Syed Ali Naqvi, Sen Zhou, Aman Gupta

Last week, I finished my Software Engineering [In]ternship at LinkedIn! It has been an incredible summer full of learning and growing both as an engineer and a person. I would like to thank some of the people who have helped me this summer starting with my managers Song Lu and Manu Jose. Thank you both for being amazing managers throughout this internship. From the talks we've had over lunch to our 1-1 chats, I learned a lot about what being in an ever-changing industry is like and the importance of adaptability and self-improvement. I appreciate you guys picking me up and letting me be a part of Venice this summer! Jialin Liu, thank you so much for being the best mentor I could ever ask for. Your guidance and support throughout these past 3 months have helped me grow greatly as an engineer. From the developing to testing and then the debugging, I was able to develop better habits that will continue to help me as a developer going forward. I would then like to give a huge thank you to Venice. You guys have been amazing to work with during this summer. Thank you all for taking the time to talk with me and share your experiences and knowledge about the field. The team's openness and willingness to help made a significant impact on my journey during this internship. Sydney Scott, your responsiveness and willingness to answer questions made a world of difference during the recruitment process and internship. Your attentiveness to each and every intern truly made an impact on us and I thank you for making each step of the way amazing. One last thank you to all the interns I met this summer, it was amazing learning alongside you all this summer, and wish you all the best of luck going forward! I've had an amazing summer and I'm looking forward to what's next!