Interests
Artificial General Intelligence (AGI) inspired by the human mind and brain structure.
Education
Sungkyunkwan University 2017 - 2024
Bachelor of Science in Department of Computer Science and Engineering Seoul, Korea
Bachelor of Arts in Department of Psychology
GPA: 4.24/4.5 | Magna Cum Laude | Transcript
Relevant Coursework: Fundamentals of Machine Learning, Emotional Intelligence and Informatics, Cognitive Science, Brain and Mind, Introduction to Computational Neuroscience, Neurogenetics, Evolution
Sabanci University Jul 2023 - Aug 2023
Summer Exchange Student Istanbul, Turkiye
University of California, Irvine Jul 2018 - Aug 2018
Undergraduate Research Internship Irvine, California, USA
Awards & Honors
SKKU OpenSource SW Activity Top Award 2023, 2024
NAVER Representative Award 2021
TOPCIT Army Chief Staff Award 2019
Student's Success Scholarship 2019
2018 SKKU BugBounty Incentive Award 2018
2017 SKKU BugBounty Special Award 2017
SungKyun Software Scholarship 2017 - 2019, 2022, 2023
Dean's List 2017 - 2019
Publications
-
Sangjun Park and JinYeong Bak. (2024). Memoria: Resolving Fateful Forgetting Problem through Human-Inspired Memory Architecture. Proceedings of the 41st International Conference on Machine Learning.
(ICML 2024 Spotlight: Acceptance Rate=3.5%) | ArXiv | OpenReview | Github -
Sangjun Park and JinYeong Bak. (2023). Lengthy Essay Generation with Summary-based Memory System. Proceedings of the Korea Software Congress, pages 1571–1573. The Korean Institute of Information Scientists and Engineers (Participation Prize)
Research Experience
Human Language Intelligence Lab Oct 2022 - Feb 2024
Undergraduate Researcher (Advisor: Professor, JinYeong Bak) Suwon, Korea
- Researched an episodic memory system for deep neural networks, Memoria, which is based on the theories of human memory formulation and forgetting with a particular focus on Hebbian theory.
- Conducted extensive experiments to prove the effectiveness of Memoria in enhancing long-term dependency consideration, applying it to Transformer-based models such as BERT and GPT.
- Participate in research developing a mental disorder detection model with a large language model and play a role in providing advice for research orientation and plan.
UCI Center for Embedded Computer Systems Jul 2018 - Aug 2018
Undergraduate Researcher (Advisor: Professor, Elaheh Bozorgzadeh) Irvine, California, USA
- Participated in a research project about locating robots within a non-GPS environment.
- Simulated a single robot localization with the dead-reckoning method in V-REP and Python and multi-robot localization with UKF filter Matlab.
Work Experience
Upstage May 2024 - Now
AI Research Engineer Suwon, Korea
- Researched and developed document-related NLP models.
Scatterlab Feb 2022 - Aug 2022
Machine Learning Researcher Seoul, Korea
- Participated in the two projects aimed at enhancing conversational model by applying memory system to it and developing hand-drawing sketch classification and generation model.
- Designed a way of memory utilization process such as extracting, memorizing, retrieving, and using the previous conversation context as a form of memory.
- Developed a memory reminder model to retrieve relevant information from memory pool based on the current context.
- Conducted pretraining BART to serve as the foundational model for memory extraction.
- Developed sketch image classifier and stroke sequence generation model based on Transformer architecture so that the stroke sequence can be converted into the sketch image.
Scatterlab Feb 2020 - Feb 2022
Machine Learning Engineer Seoul, Korea
- Played a key role in diverse projects involving the development of an open-domain conversational chatbot agent, Luda-Lee. The tasks included enhancing the data processing pipeline, implementing an automatic finetuning & evaluation system, conducting model distillation, and so on.
- Developed a person name recognition model to de-identify person names and designed a sophisticated de-identification algorithm.
- Conducted comprehensive experiments to compare various vector similarity frameworks and built reply embedding index with a famous vector similarity search framework, faiss.
- Optimized BERT-based classification models through the application of knowledge distillation method to reduce model inference time while preserving the original performance.
- Constructed automated pipelines with Kubeflow to finetune and evaluate language models in order to get a trained model and result metrics easily.
Activities
AI + Human Writing Competition Jan 2023
AI Model Developer Suwon, Korea
- Participated in a writing competition where human writes an essay about a given topic using their essay generation models. [Github]
- Resolved long-term dependency problem to generate text over 20,000 characters by employing a summarization model to abstract the previous context and received good comments in technical aspects.
2021 Korean Voice and Natural Language AI competition Sep 2021 - Nov 2021
Team Leader Seoul, Korea
- Won the prize in a dialogue summarization competition with a total prize of $27K. [Github]
- Researched and developed dialogue summarization model applying SOTA methods and original ideas.
SW Maestro: Legato May 2019 - Nov 2019
Team Leader, Developer, and ML Engineer Seoul, Korea
- Led a chatbot development government-funded team project aimed at improving mental health.
- Researched and developed multiple natural language processing models such as sentence similarity model or conditional response generation model, etc.
- Released StoryForest to Google Play Store, the application was downloaded over 1000 times.
2018 SKKU BugBounty Oct 2018
Participant Suwon, Korea
- Won the incentive award to find vulnerabilities such as cookie reuse and SQL injection.
Hacker's In inTrusion Dec 2017 - Jan 2019
President Suwon, Korea
- Operated university information security club and taught club members basic hacking and security.
2017 SKKU BugBounty May 2017
Participant Suwon, Korea
- Won the special award to find web vulnerabilities such as cross site scripting and web shell uploading.
Teaching Experience
Mentoring Foreign Students in Major Classes Sep 2022 - Dec 2022
Mentor Suwon, Korea
- Taught foreign students about the data structure course and provided answers to their questions.
Arduino Mentoring Dec 2019
Instructor Suwon, Korea
- Taught high school students Arduino (making RC car with Bluetooth, ultrasonic, and other modules).
Computational Thinking and Software Coding Mar 2019 - Jun 2019
Teaching Assistant Seoul, Korea
- Conducted practical lessons on Entry and basic Python syntax for students.
Freshman Python Education Feb 2019 & Feb 2018
Teaching Assistant Suwon, Korea
- Taught how to solve basic algorithm problems with Python to freshmen.
Competences
Languages Korean (native), English (fluent)
Techniques Python, C/C++, Go, Java, Javascript, Arduino, Visual Studio Code, Tensorflow, Pytorch, git, Docker, Flask, Kubernetes, Kubeflow, Faiss, AWS, GCP, LaTeX
Interests Writing, Calligraphy, Playing Piano, Board Game, Reading Books, Magic