[BUG]: Bot retrieves wrong job tittle and (sometimes) company name from LinkedIn
dzx opened this issue · comments
Describe the bug
It accepts LinkedIn job URL and then generated cover letter with wrong position tittle and company name
Steps to reproduce
- Start the script and ask for custom cover letter.
- Supply the following URL
open_ai_calls.json contains following output, indicating that ChatGPT is sometimes being fed irrelevant chunks of the job description page
{
"model": "gpt-4o-mini-2024-07-18",
"time": "2025-01-19 01:54:12",
"prompts": {
"prompt_1": "\n You are an expert in extracting specific information from job descriptions. \n Carefully read the job description context below and provide a clear and concise answer to the question.\n\n Context: =\"https://www.linkedin.com/jobs/computer-scientist-jobs?trk=public_jobs_linkster_link\" data-js-module-id=\"link-column-link\" data-tracking-control-name=\"public_jobs_linkster_link\" data-tracking-will-navigate=\"\">\n Computer Scientist jobs\n </a>\n </li>\n <li class=\"tw-link-column-item\">\n \n \n <a class=\"link tw-linkster-link\" href=\"https://www.linkedin.com/jobs/engineering-and-maintenance-manager-jobs?trk=public_jobs_linkster_link\" data-js-module-id=\"link-column-link\" data-tracking-control-name=\"public_jobs_linkster_link\" data-tracking-will-navigate=\"\">\n Engineering And Maintenance Manager jobs\n </a>\n </li>\n <li class=\"tw-link-column-item\">\n \n \n <a class=\"link tw-linkster-link\" href=\"https://www.linkedin.com/jobs/telos-corporation-jobs?trk=public_jobs_linkster_link\" data-js-module-id=\"link-column-link\" data-tracking-control-name=\"public_jobs_linkster_link\" data-tracking-will-navigate=\"\">\n \n\n \n 54,422 open jobs\n \n </div>\n\n<!----> </div>\n<!----> \n \n </a>\n \n \n \n \n </li>\n <li>\n \n\n \n\n \n<!----> \n \n <a href=\"https://www.linkedin.com/jobs/science-manager-jobs?trk=public_jobs_full-click\" target=\"_self\" data-tracking-control-name=\"public_jobs_full-click\" data-tracking-will-navigate=\"\" class=\"base-card relative w-full hover:no-underline focus:no-underline base-card--link base-aside-card flex my-1.5\n \n base-aside-card--link aside-job-search-result-card\">\n \n\n<!---->\n \n<!---->\n <div class=\"base-aside-card__info self-center pl-0.5 flex flex-col flex-1\">\n <h3 class=\"base-aside-card__title font-sans text-md font-bold text-color-text relative\">\n \n Science Manager jobs\n \n<!----> </h3>\n\n<!---->\n<!---->\n<!---->\n <div class=\"\n\n\n \n \n </li>\n <li>\n \n\n \n\n \n<!----> \n \n <a href=\"https://www.linkedin.com/jobs/support-team-manager-jobs?trk=public_jobs_full-click\" target=\"_self\" data-tracking-control-name=\"public_jobs_full-click\" data-tracking-will-navigate=\"\" class=\"base-card relative w-full hover:no-underline focus:no-underline base-card--link base-aside-card flex my-1.5\n \n base-aside-card--link aside-job-search-result-card\">\n \n\n<!---->\n \n<!---->\n <div class=\"base-aside-card__info self-center pl-0.5 flex flex-col flex-1\">\n <h3 class=\"base-aside-card__title font-sans text-md font-bold text-color-text relative\">\n \n Support Team Manager jobs\n \n<!----> </h3>\n\n<!---->\n<!---->\n<!---->\n <div class=\"base-aside-card__metadata font-sans text-sm leading-open font-regular text-color-text-low-emphasis mt-0.5\">\n \n 83,600 open jobs\n \n </div>\n\n<!----\n\n Question: What is the role or title sought in this job description?\n Answer:\n "
},
"replies": "The roles or titles sought in this job description include \"Computer Scientist,\" \"Engineering And Maintenance Manager,\" \"Science Manager,\" and \"Support Team Manager.\"",
"total_tokens": 786,
"input_tokens": 755,
"output_tokens": 31,
"total_cost": 0.00013185
}
{
"model": "gpt-4o-mini-2024-07-18",
"time": "2025-01-19 01:54:13",
"prompts": {
"prompt_1": "\n You are an expert in extracting specific information from job descriptions. \n Carefully read the job description context below and provide a clear and concise answer to the question.\n\n Context: OnXM9MPQ%3D%3D&trackingId=t2TjD1vBlQN5zwNyfPSQsg%3D%3D\" data-tracking-control-name=\"public_jobs_similar-jobs\" data-tracking-client-ingraph=\"\" data-tracking-will-navigate=\"\">\n \n <span class=\"sr-only\">\n \n \n Member of Technical Staff\n \n \n </span>\n </a>\n\n \n \n <img class=\"inline-block relative w-6 h-6 lazy-loaded\" data-ghost-classes=\"bg-color-entity-ghost-background\" data-ghost-url=\"https://static.licdn.com/aero-v1/sc/h/eojn00s72k70vnw5r0xj92t9e\" alt=\"\" aria-busy=\"false\" src=\"https://media.licdn.com/dms/image/v2/D560BAQFTpr7PF32hXw/company-logo_100_100/company-logo_100_100/0/1715366332792/phnyx_lab_logo?e=2147483647&v=beta&t=OOmho3D-mRygy81-Xfr4k3KA25zMm7ufZu_mJl1i3tw\">\n \n\n <div class=\"base-main-card__info self-center ml-1 flex-1 relative break-words papabear:min-w-0 mamabear:min-w-0 babybear:w-full\n \">\n<!----> \n\nId=JdqfXMwVWHaPRtOnXM9MPQ%3D%3D&trackingId=1s%2FB6fr9GD%2FQ3AzF2jDEUA%3D%3D\" data-tracking-control-name=\"public_jobs_similar-jobs\" data-tracking-client-ingraph=\"\" data-tracking-will-navigate=\"\">\n \n <span class=\"sr-only\">\n \n \n Member of Technical Staff (Extraction)\n \n \n </span>\n </a>\n\n \n \n <img class=\"inline-block relative w-6 h-6 lazy-loaded\" data-ghost-classes=\"bg-color-entity-ghost-background\" data-ghost-url=\"https://static.licdn.com/aero-v1/sc/h/eojn00s72k70vnw5r0xj92t9e\" alt=\"\" aria-busy=\"false\" src=\"https://media.licdn.com/dms/image/v2/D4D0BAQGmpdwatatXfQ/company-logo_100_100/company-logo_100_100/0/1693320059529/contextualai_logo?e=2147483647&v=beta&t=IDLeyhygKZ8wK3adAtd7MdasZIp9Bhkx1PT6ONNpXlg\">\n \n\n <div class=\"base-main-card__info self-center ml-1 flex-1 relative break-words papabear:min-w-0 mamabear:min-w-0 babybear:w-full\n \n\nQ/company-logo_100_100/company-logo_100_100/0/1630652622688/microsoft_logo?e=2147483647&v=beta&t=lMkCSsceJNmUG1r0VRg3Whye1sVi2KtYvt-MWyfoNbY\">\n \n \n </a>\n \n \n\n <div class=\"top-card-layout__entity-info-container flex flex-wrap papabear:flex-nowrap\">\n <div class=\"top-card-layout__entity-info flex-grow flex-shrink-0 basis-0 babybear:flex-none babybear:w-full babybear:flex-none babybear:w-full\">\n \n <h1 class=\"top-card-layout__title font-sans text-lg papabear:text-xl font-bold leading-open text-color-text mb-0 topcard__title\">Member of Technical Staff, AI - Reinforcement Learning (RL) Platform</h1>\n \n<!---->\n<!---->\n <h4 class=\"top-card-layout__second-subline font-sans text-sm leading-open text-color-text-low-emphasis mt-0.5\">\n \n <div class=\"topcard__flavor-row\">\n <span class=\"topcard__flavor\">\n <a class=\"topcard__org-name-link topcard__flavor--black-link\" data-tracking-control-name=\"public_jobs_topcard-org-name\" data\n\n Question: What is the company's name?\n Answer:\n "
},
"replies": "The company's name is Microsoft.",
"total_tokens": 992,
"input_tokens": 985,
"output_tokens": 7,
"total_cost": 0.00015194999999999998
}
{
"model": "gpt-4o-mini-2024-07-18",
"time": "2025-01-19 01:54:15",
"prompts": {
"prompt_1": "\n You are an expert in extracting specific information from job descriptions. \n Carefully read the job description context below and provide a clear and concise answer to the question.\n\n Context: , you are required to be local to the San Francisco area OR Seattle area and in office 3 days a week. <br><br></em>Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.<br><br><strong>Responsibilities<br><br></strong><ul><li>Design and develop the core infrastructure of the RL Platform, focusing on systematizing and extending RL algorithms for LLMs to a variety of present and future environments.</li><li>Assist in development of new algorithms and help onboard other team members to state-of-the-art techniques.</li><li>Collaborate with cross-functional teams to ship new agentic AI product capabilities.</li><li>Embody our culture of collaboration, innovation, and excellence.<br><br></li></ul><strong>Qualifications<br><br></strong><strong>Required Qualifications:<br><br></strong><ul><li>Bachelor's Degree in Computer Science, Software Engineering, Computer Engineering, Machine Learning, Mathematics, or related STEM fields and 4+ years of experience in coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python</li><li>OR equivalent experience.</li><li>Experience with large-scale software systems and infrastructure.</li><li>Demonstrated interest in reinforcement learning, language modelling, generative modelling, or related domains.<br><br></li></ul><strong>Preferred Qualifications<br><br></strong><ul><li>Bachelor's Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python</li><li>o OR Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python</li><li>o OR equivalent experience.</li><li>Background in scientific computing or machine learning.</li><li>Experience with large\n\n>\n<!---->\n<!---->\n <div class=\"core-section-container__content break-words\">\n \n \n \n \n\n<!----> \n\n <div class=\"description__text description__text--rich\">\n \n \n \n \n\n <section class=\"show-more-less-html\" data-max-lines=\"5\">\n <div class=\"show-more-less-html__markup show-more-less-html__markup--clamp-after-5\n relative overflow-hidden\">\n <strong>Overview<br><br></strong><strong>Help build the world’s most advanced reinforcement learning platform at Microsoft AI.<br><br></strong>We're on a mission to create trustworthy agents capable of autonomous action and decision-making on behalf of our users. As part of our team, you’ll help advance state-of-the-art algorithms for model alignment and develop tools to extend model capabilities to numerous product domains within Microsoft.<br><br>We Are Looking For Candidates Who Are Both Scientists And Software Engineers. The Ideal Candidate Will Be Able To Build Robust Systems That Help Our Team Solve The Next Generation Of AI Problems. They Would<br><br><ul><li>Excel in coding, software engineering, and API design</li><li>Have a background in machine learning and scientific computing</li><li>Thrive in a highly collaborative, fast-paced environment</li><li>Have a high degree of craftsmanship and pay close attention to details</li><li>Effectively manage multiple responsibilities and can adjust to shifting priorities<br><br></li></ul><em>By applying to this U.S. Mountain View, CA OR Redmond, WA position, you are required to be local to the San Francisco area OR Seattle area and in office 3 days a week. <br><br></em>Microsoft’s mission is to empower every person and every organization on the planet to achieve more.\n\n \n Member of Technical Staff 2 (AHV)\n \n </h3>\n \n\n <h4 class=\"base-main-card__subtitle body-text text-color-text overflow-hidden\n \">\n \n <a class=\"hidden-nested-link outline-offset-[-1px]\" href=\"https://www.linkedin.com/company/nutanix?trk=public_jobs_similar-jobs_main-jobs-card-subtitle\" data-tracking-client-ingraph=\"\" data-tracking-control-name=\"public_jobs_similar-jobs_main-jobs-card-subtitle\" data-tracking-will-navigate=\"\">\n Nutanix\n </a>\n \n </h4>\n\n<!---->\n <div class=\"body-text text-color-text-low-emphasis base-main-card__metadata\">\n \n <span class=\"main-job-card__location block mb-0.5 text-md leading-open font-normal text-color-text-low-emphasis\">\n San Jose, CA\n </span>\n\n <span class=\"main-job-card__salary-info block my-0.5 mx-0\"><br> $133,600.00<br> -<br> \n\n Question: What is the job description of the company?\n Answer:\n "
},
"replies": "The job description is for a position at Microsoft focused on building the world's most advanced reinforcement learning platform. The role involves designing and developing core infrastructure for reinforcement learning algorithms, collaborating with cross-functional teams, and assisting in the development of new algorithms. Candidates are expected to have a strong background in coding, software engineering, and machine learning, with experience in large-scale software systems and a demonstrated interest in reinforcement learning and related domains. The position requires being local to the San Francisco or Seattle area and working in the office three days a week.",
"total_tokens": 1256,
"input_tokens": 1149,
"output_tokens": 107,
"total_cost": 0.00023654999999999998
}
{
"model": "gpt-4o-mini-2024-07-18",
"time": "2025-01-19 01:54:16",
"prompts": {
"prompt_1": "\n You are an expert in extracting specific information from job descriptions. \n Carefully read the job description context below and provide a clear and concise answer to the question.\n\n Context: \n\n \n \n \n\n \n \n \n\n \n \n\n <section class=\"dismissable-input text-input !pr-3 bg-color-transparent flex items-center h-[40px] min-w-0 relative babybear:w-full babybear:mb-1 typeahead-input location-typeahead-input\">\n <input aria-autocomplete=\"list\" aria-controls=\"job-search-bar-location-typeahead-list\" aria-haspopup=\"listbox\" aria-label=\"Location\" autocomplete=\"off\" class=\"dismissable-input__input font-sans text-md text-color-text bg-color-transparent flex items-center flex-1 focus:outline-none placeholder:text-color-text-secondary\" data-tracking-control-name=\"public_jobs_dismissable-input\" id=\"job-search-bar-location\" maxlength=\"500\" name=\"location\" placeholder=\"Location\" role=\"combobox\" value=\"San Francisco, CA\" type=\"search\" aria-expanded=\"false\">\n \n<!----> <div class=\"typeahead-input__dropdown container-lined absolute top-[calc(100%+3px)] left-0 w-full rounded-b-md rounded-t-none z-[10] overflow-hidden max-w-none babybear:min-w-full babybear:bottom-0 babybear:overflow-y-auto\">\n <template class=\"typeahead-item-template\">\n <li class=\"typeahead-input__dropdown-item py-1.5 px-2 hover:cursor-pointer hover:bg-color-surface-new-hover hover:border-y-2 hover:border-solid hover:border-color-container-primary\" role=\"option\">\n <span class=\"typeahead\n\ntracking-will-navigate=\"\">\n Samaya AI\n </a>\n \n </h4>\n\n<!---->\n <div class=\"body-text text-color-text-low-emphasis base-main-card__metadata\">\n \n <span class=\"main-job-card__location block mb-0.5 text-md leading-open font-normal text-color-text-low-emphasis\">\n Mountain View, CA\n </span>\n\n<!---->\n <time class=\"main-job-card__listdate text-color-text-low-emphasis font-normal\n text-sm leading-open\" datetime=\"2024-11-04\">\n \n\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n\n 2 months ago\n \n </time>\n\n<!----> \n </div>\n<!----> </div>\n\n\n \n <span class=\"main-job-card__location block mb-0.5 text-md leading-open font-normal text-color-text-low-emphasis\">\n Palo Alto, CA\n </span>\n\n<!---->\n <time class=\"main-job-card__listdate text-color-text-low-emphasis font-normal\n text-sm leading-open\" datetime=\"2024-05-20\">\n \n\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n \n\n \n \n \n \n \n \n \n \n \n \n \n \n \n \n\n 8 months ago\n \n </time>\n\n<!----> \n </div>\n<!----> </div>\n\n<!----> \n \n </div>\n \n \n \n \n </li>\n <li>\n \n\n \n\n \n \n \n\n Question: What is the location mentioned in this job description?\n Answer:\n "
},
"replies": "The locations mentioned in the job description are Mountain View, CA and Palo Alto, CA.",
"total_tokens": 683,
"input_tokens": 664,
"output_tokens": 19,
"total_cost": 0.00011099999999999999
}
{
"model": "gpt-4o-mini-2024-07-18",
"time": "2025-01-19 01:54:23",
"prompts": {
"prompt_1": "\nAs a seasoned HR expert, your task is to identify and outline the key skills and requirements necessary for the position of this job. Use the provided job description as input to extract all relevant information. This will involve conducting a thorough analysis of the job's responsibilities and the industry standards. You should consider both the technical and soft skills needed to excel in this role. Additionally, specify any educational qualifications, certifications, or experiences that are essential. Your analysis should also reflect on the evolving nature of this role, considering future trends and how they might affect the required competencies.\n\nRules:\nRemove boilerplate text\nInclude only relevant information to match the job description against the resume\n\n# Analysis Requirements\nYour analysis should include the following sections:\nTechnical Skills: List all the specific technical skills required for the role based on the responsibilities described in the job description.\nSoft Skills: Identify the necessary soft skills, such as communication abilities, problem-solving, time management, etc.\nEducational Qualifications and Certifications: Specify the essential educational qualifications and certifications for the role.\nProfessional Experience: Describe the relevant work experiences that are required or preferred.\nRole Evolution: Analyze how the role might evolve in the future, considering industry trends and how these might influence the required skills.\n\n# Final Result:\nYour analysis should be structured in a clear and organized document with distinct sections for each of the points listed above. Each section should contain:\nThis comprehensive overview will serve as a guideline for the recruitment process, ensuring the identification of the most qualified candidates.\n\n# Job Description:\n```\nThe job description is for a position at Microsoft focused on building the world's most advanced reinforcement learning platform. The role involves designing and developing core infrastructure for reinforcement learning algorithms, collaborating with cross-functional teams, and assisting in the development of new algorithms. Candidates are expected to have a strong background in coding, software engineering, and machine learning, with experience in large-scale software systems and a demonstrated interest in reinforcement learning and related domains. The position requires being local to the San Francisco or Seattle area and working in the office three days a week.\n```\n\n---\n\n# Job Description Summary"
},
"replies": "# Key Skills and Requirements Analysis for Reinforcement Learning Platform Position at Microsoft\n\n## Technical Skills\n- **Programming Languages**: Proficiency in languages such as Python, C++, or Java, essential for developing algorithms and software.\n- **Machine Learning**: Strong understanding of machine learning principles, particularly in reinforcement learning.\n- **Software Engineering**: Experience in software development practices, including version control, testing, and debugging.\n- **Large-Scale Systems**: Familiarity with designing and implementing large-scale software systems that can handle complex data and processes.\n- **Algorithm Development**: Ability to design, implement, and optimize algorithms, particularly in the context of reinforcement learning.\n- **Cross-Functional Collaboration Tools**: Experience with tools that facilitate collaboration among teams, such as project management software.\n\n## Soft Skills\n- **Communication**: Strong verbal and written communication skills to effectively collaborate with cross-functional teams and explain complex concepts.\n- **Problem-Solving**: Ability to approach complex challenges analytically and creatively, developing innovative solutions.\n- **Teamwork**: Proven ability to work collaboratively in a team environment, contributing to shared goals.\n- **Adaptability**: Flexibility to adapt to changing project requirements and technologies in a fast-paced environment.\n- **Time Management**: Strong organizational skills to manage multiple tasks and deadlines efficiently.\n\n## Educational Qualifications and Certifications\n- **Degree**: A Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, or a related field is essential.\n- **Certifications**: Relevant certifications in machine learning, data science, or software engineering (e.g., AWS Certified Machine Learning, Google Professional Machine Learning Engineer) are preferred but not mandatory.\n\n## Professional Experience\n- **Relevant Work Experience**: A minimum of 3-5 years of experience in software development, with a focus on machine learning or artificial intelligence.\n- **Project Experience**: Demonstrated experience working on projects involving reinforcement learning or similar advanced machine learning techniques.\n- **Industry Experience**: Previous experience in tech companies, particularly in roles related to AI or machine learning, is highly advantageous.\n\n## Role Evolution\n- **Increased Focus on AI**: As AI and machine learning technologies continue to evolve, the role will likely require ongoing education in the latest advancements in reinforcement learning and algorithm development.\n- **Integration with Other Technologies**: Future trends may involve greater integration of reinforcement learning with other emerging technologies such as edge computing, IoT, and cloud services, necessitating a broader technical skill set.\n- **Collaboration with Diverse Teams**: The role may increasingly involve collaboration with non-technical teams (e.g., product management, marketing) to align AI initiatives with business objectives, highlighting the need for enhanced communication and interpersonal skills.\n- **Ethical Considerations**: As AI ethics becomes more prominent, understanding ethical implications and responsible AI practices will be critical for candidates in this role.\n\nThis comprehensive overview serves as a guideline for the recruitment process, ensuring the identification of the most qualified candidates for the reinforcement learning platform position at Microsoft.",
"total_tokens": 1036,
"input_tokens": 424,
"output_tokens": 612,
"total_cost": 0.00043079999999999995
}
{
"model": "gpt-4o-mini-2024-07-18",
"time": "2025-01-19 01:54:29",
"prompts": {
"prompt_1": "\nCompose a brief and impactful cover letter based on the provided job description and resume. The letter should be no longer than three paragraphs and should be written in a professional, yet conversational tone. Avoid using any placeholders, and ensure that the letter flows naturally and is tailored to the job.\n\nAnalyze the job description to identify key qualifications and requirements. Introduce the candidate succinctly, aligning their career objectives with the role. Highlight relevant skills and experiences from the resume that directly match the job’s demands, using specific examples to illustrate these qualifications. Reference notable aspects of the company, such as its mission or values, that resonate with the candidate’s professional goals. Conclude with a strong statement of why the candidate is a good fit for the position, expressing a desire to discuss further.\n\nPlease write the cover letter in a way that directly addresses the job role and the company’s characteristics, ensuring it remains concise and engaging without unnecessary embellishments. The letter should be formatted into paragraphs and should not include a greeting or signature.\n\n## Rules:\n- Do not include any introductions, explanations, or additional information.\n\n## Details :\n- **Job Description:**\n```\n# Key Skills and Requirements Analysis for Reinforcement Learning Platform Position at Microsoft\n\n## Technical Skills\n- **Programming Languages**: Proficiency in languages such as Python, C++, or Java, essential for developing algorithms and software.\n- **Machine Learning**: Strong understanding of machine learning principles, particularly in reinforcement learning.\n- **Software Engineering**: Experience in software development practices, including version control, testing, and debugging.\n- **Large-Scale Systems**: Familiarity with designing and implementing large-scale software systems that can handle complex data and processes.\n- **Algorithm Development**: Ability to design, implement, and optimize algorithms, particularly in the context of reinforcement learning.\n- **Cross-Functional Collaboration Tools**: Experience with tools that facilitate collaboration among teams, such as project management software.\n\n## Soft Skills\n- **Communication**: Strong verbal and written communication skills to effectively collaborate with cross-functional teams and explain complex concepts.\n- **Problem-Solving**: Ability to approach complex challenges analytically and creatively, developing innovative solutions.\n- **Teamwork**: Proven ability to work collaboratively in a team environment, contributing to shared goals.\n- **Adaptability**: Flexibility to adapt to changing project requirements and technologies in a fast-paced environment.\n- **Time Management**: Strong organizational skills to manage multiple tasks and deadlines efficiently.\n\n## Educational Qualifications and Certifications\n- **Degree**: A Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, or a related field is essential.\n- **Certifications**: Relevant certifications in machine learning, data science, or software engineering (e.g., AWS Certified Machine Learning, Google Professional Machine Learning Engineer) are preferred but not mandatory.\n\n## Professional Experience\n- **Relevant Work Experience**: A minimum of 3-5 years of experience in software development, with a focus on machine learning or artificial intelligence.\n- **Project Experience**: Demonstrated experience working on projects involving reinforcement learning or similar advanced machine learning techniques.\n- **Industry Experience**: Previous experience in tech companies, particularly in roles related to AI or machine learning, is highly advantageous.\n\n## Role Evolution\n- **Increased Focus on AI**: As AI and machine learning technologies continue to evolve, the role will likely require ongoing education in the latest advancements in reinforcement learning and algorithm development.\n- **Integration with Other Technologies**: Future trends may involve greater integration of reinforcement learning with other emerging technologies such as edge computing, IoT, and cloud services, necessitating a broader technical skill set.\n- **Collaboration with Diverse Teams**: The role may increasingly involve collaboration with non-technical teams (e.g., product management, marketing) to align AI initiatives with business objectives, highlighting the need for enhanced communication and interpersonal skills.\n- **Ethical Considerations**: As AI ethics becomes more prominent, understanding ethical implications and responsible AI practices will be critical for candidates in this role.\n\nThis comprehensive overview serves as a guideline for the recruitment process, ensuring the identification of the most qualified candidates for the reinforcement learning platform position at Microsoft.\n```\n- **My resume:**\n```\npersonal_information=PersonalInformation(name='Sasha', surname='Jaksic', date_of_birth='30/10/1975', country='USA', city='San Francisco', address='574 3rd. st.', zip_code='94107', phone_prefix='+1', phone='4153353945', email='dzx303@gmail.com', github=HttpUrl('https://github.com/dzx'), linkedin=HttpUrl('https://www.linkedin.com/in/sjaksic/')) education_details=[EducationDetails(education_level=\"Master's Degree\", institution='San Francisco State University', field_of_study='Computer Science', final_evaluation_grade='4', start_date='2002', year_of_completion=2005, exam=None)] experience_details=[ExperienceDetails(position='Machine Learning Engineer', company='Clostra', employment_period='03/2020 - 02/2024', location='Remote', industry='Technology', key_responsibilities=[{'responsibility_1': 'Technical lead'}, {'responsibility_2': 'Machine learning engineer'}, {'responsibility_3': 'Machine learning infrastructure engineer - reinforcement learning training'}], skills_acquired=['Pytorch', 'Scrum', 'Docker', 'Video Object Detection', 'Sequence to sequence prediction', 'PANDAS', 'Scikit-learn', 'PostgreSQL']), ExperienceDetails(position='Independent Consultant', company='Self Employed', employment_period='02/2019 - 03/2020', location='Remote', industry='Consulting', key_responsibilities=[{'responsibility_1': 'Mentored students of Robotics, C++ and Self Driving Car Engineering programs with Udacity'}, {'responsibility_2': 'Developed confidential Python service for Recogni'}], skills_acquired=['OpenCV', 'Deep Learning', 'Python', 'Numpy', 'Tensorflow', 'Sensor Fusion', 'Motion Planing', 'Control Theory', 'ROS', 'C++']), ExperienceDetails(position='Senior Software Engineer', company='Yapstone', employment_period='03/2009 - 11/2016', location='Walnut Creek', industry='Fintech', key_responsibilities=[{'responsibility_1': 'Designed and implemented a data integration system for automated merchant setup with First National.'}, {'responsibility_2': 'Optimized and refactored a number of payment processing components to improve scalability allowing Yapstone to keep doubling revenue 5 years in a row.'}, {'responsibility_3': 'Extended proprietary object-relational persistence system to migrate storage from MS SQL Server to MySQL'}], skills_acquired=['Distributed systems', 'Refactoring', 'Optimization', 'Message Queues', 'MySQL']), ExperienceDetails(position='Senior Software Engineer', company='Yodlee', employment_period='03/2008 - 03/2009', location='Foster City', industry='Fintech', key_responsibilities=[{'responsibility_1': 'Designed and developed Ebills feature for BillPay 9.0.1'}, {'responsibility_2': 'Designed and developed, uncollected payment funds, and payment stop request processing for BillPay 9.0'}], skills_acquired=['Java', 'J2EE', 'Object Oriented Design', 'Oracle'])] projects=[Project(name='Deep Learning Based Height Of Burst Estimator', description='System for detecting and estimating position of distant small transient objects using an array of cameras, object detection and 3D reconstruction algorithms. Contributed as tech lead, machine learning and full stack engineer.', link=None), Project(name='Graph Neural Network Based Drone Swarming', description='Proof of concept for coordination of drones in autonomous swarms using deep reinforcement learning. Contributed by designing, building and maintaining reinforcement learning training infrastructure.', link=None), Project(name='Context-Aided Object Detection', description='Proof of concept for advanced video object detection algorithm using multi-modal video and text input to detect and classify objects of interest in highly degraded video footage.', link=None), Project(name='Globally Integrated Wargaming', description='Complex distributed geo-political strategy game backed by reinforcement-learning and time-series forecasting algorithms. Contributed as machine learning engineer and technical lead alongside 3 other engineers and a scientist.', link=None)] achievements=[Achievement(name='Kaggle competition expert', description='Winner of 2 silver and one broze medal at different Kaggle competitions'), Achievement(name='[Achievement Name]', description='[Achievement Description]')] certifications=[Certifications(name='Udacity Generative AI NanoDegree', description='4-month program covering LLM principles, fine-tuning, RAG, LangChain, Difusion and transformer models and GANs'), Certifications(name='Udacity Self-driving Car Engineering Nanodegree', description='10-month program covering perception, motion planing, control theory and system integration applied to autonomous vehicles')] languages=[Language(language='English', proficiency='Fluent'), Language(language='Serbian', proficiency='Fluent'), Language(language='Russian', proficiency='Basic')] interests=['Machine Learning', 'AI', 'Music']\n```\n\n- **Template to Use**\n```\n<section id=\"cover-letter\">\n <div style=\"display: flex; justify-content: space-between; align-items: flex-start; margin-bottom: 20px;\">\n <div>\n <p>[Your Name]</p>\n <p>[Your Address]</p>\n <p>[City, State ZIP]</p>\n <p>[Your Email]</p>\n <p>[Your Phone Number]</p>\n </div>\n <div style=\"text-align: right;\">\n <p>[Company Name]</p>\n </div>\n </div>\n <div>\n <p>Dear [Recipient Team],</p>\n <p>[Opening paragraph: Introduce yourself and state the position you are applying for.]</p>\n <p>[Body paragraphs: Highlight your qualifications, experiences, and how they align with the job requirements.]</p>\n <p>[Closing paragraph: Express your enthusiasm for the position and thank the recipient for their consideration.]</p>\n <p>Sincerely,</p>\n <p>[Your Name]</p>\n <p>[Date]</p>\n </div>\n</section>\n```\nThe results should be provided in html format, Provide only the html code for the cover letter, without any explanations or additional text and also without ```html ```\n"
},
"replies": "<section id=\"cover-letter\">\n <div style=\"display: flex; justify-content: space-between; align-items: flex-start; margin-bottom: 20px;\">\n <div>\n <p>Sasha Jaksic</p>\n <p>574 3rd. st.</p>\n <p>San Francisco, CA 94107</p>\n <p>dzx303@gmail.com</p>\n <p>4153353945</p>\n </div>\n <div style=\"text-align: right;\">\n <p>Microsoft</p>\n </div>\n </div>\n <div>\n <p>I'm excited to apply for the Reinforcement Learning Platform position at Microsoft. With a Master's degree in Computer Science and over 5 years of experience in machine learning and software engineering, I am eager to contribute to your mission of empowering every person and organization on the planet to achieve more.</p>\n <p>At Clostra, I served as a Machine Learning Engineer and technical lead, where I developed reinforcement learning training infrastructure and collaborated on projects that required innovative algorithm development. My proficiency in Python and experience with large-scale systems, combined with my background in deep learning and video object detection, align well with the requirements of this role. Additionally, my work on the Graph Neural Network Based Drone Swarming project exemplifies my ability to tackle complex challenges and deliver effective solutions in a team environment.</p>\n <p>I admire Microsoft's commitment to ethical AI and continuous innovation, and I am enthusiastic about the opportunity to work in a collaborative setting that values diverse perspectives. I look forward to discussing how my skills and experiences can contribute to the success of your team.</p>\n <p>Sincerely,</p>\n <p>Sasha Jaksic</p>\n <p>[Date]</p>\n </div>\n</section>",
"total_tokens": 2553,
"input_tokens": 2168,
"output_tokens": 385,
"total_cost": 0.0005562
}
Expected behavior
Expected job tittle in cover letter should be something like "Member of Technical Staff, AI - Reinforcement Learning (RL) Platform"
Actual behavior
Job tittle in cover letter is somewhat wrong: "Reinforcement Learning Platform"
Branch
main
Branch name
No response
Python version
3.10.16
LLM Used
ChatGPT
Model used
gpt-4o-mini-2024-07-18
Additional context
On other runs, when generating custom resume for same URL I was able to obtain ChatGPT API call logs like below. It probably didn't affect actual resume, but it can be seen that script fed some of the job tittles and companies from 'People also viewed' section to ChatGPT, hence wrong job tittle and company name. I think resume_facade.py should use more specific targeting for different sections of job page in order to avoid names and companies of related jobs leaking into the cover letter. For example actual job description is currently inside <div class="decorated-job-posting__details">...</div> and tittle is inside <div class="top-card-layout__entity-info flex-grow flex-shrink-0 basis-0 babybear:flex-none babybear:w-full babybear:flex-none babybear:w-full">...</div>
Here is the aforementioned log showing irrelevant chunks being fed to ChatGPT:
{
"model": "gpt-4o-mini-2024-07-18",
"time": "2025-01-18 23:09:13",
"prompts": {
"prompt_1": "\n You are an expert in extracting specific information from job descriptions. \n Carefully read the job description context below and provide a clear and concise answer to the question.\n\n Context: 2FmdblvHab5g%3D%3D&trackingId=SjIkdjVfRAnLZctbKVNN3Q%3D%3D\" data-tracking-control-name=\"public_jobs_similar-jobs\" data-tracking-client-ingraph=\"\" data-tracking-will-navigate=\"\">\n \n <span class=\"sr-only\">\n \n \n Member of Technical Staff II, Architecture Team\n \n \n </span>\n </a>\n\n \n \n <img class=\"inline-block relative w-6 h-6\" data-ghost-classes=\"bg-color-entity-ghost-background\" data-ghost-url=\"https://static.licdn.com/aero-v1/sc/h/eojn00s72k70vnw5r0xj92t9e\" alt=\"\" aria-busy=\"true\" src=\"https://media.licdn.com/dms/image/v2/D560BAQFoizPEFmyakQ/company-logo_100_100/company-logo_100_100/0/1729803311245/illumio_logo?e=2147483647&v=beta&t=mnCq03oIMCGYC-WxVlgM8QMWTI0L0XWfw9iydpPj4jA\">\n \n\n <div class=\"base-main-card__info self-center ml-1 flex-1 relative break-words papabear:min-w-0 mamabear:min-w-0 babybear:w-full\n \">\n<!----> \n\nD%3D&trackingId=9zVfweMO0QQNudRqsjDSZw%3D%3D\" data-tracking-control-name=\"public_jobs_similar-jobs\" data-tracking-client-ingraph=\"\" data-tracking-will-navigate=\"\">\n \n <span class=\"sr-only\">\n \n \n Member Technical Staff (JoinOCI-SDE)\n \n \n </span>\n </a>\n\n \n \n <img class=\"inline-block relative w-6 h-6\" data-ghost-classes=\"bg-color-entity-ghost-background\" data-ghost-url=\"https://static.licdn.com/aero-v1/sc/h/eojn00s72k70vnw5r0xj92t9e\" alt=\"\" aria-busy=\"true\" src=\"https://media.licdn.com/dms/image/v2/D4E0BAQHYCgYovUuPtQ/company-logo_100_100/company-logo_100_100/0/1665755678957/oracle_logo?e=2147483647&v=beta&t=55lZDJhHdt3oPj2_gdPpymKz6Wv_9atXeO-CBFzAm6c\">\n \n\n <div class=\"base-main-card__info self-center ml-1 flex-1 relative break-words papabear:min-w-0 mamabear:min-w-0 babybear:w-full\n \">\n<!----> \n\n3D\" data-tracking-control-name=\"public_jobs_similar-jobs\" data-tracking-client-ingraph=\"\" data-tracking-will-navigate=\"\">\n \n <span class=\"sr-only\">\n \n \n Member of Technical Staff (Backend)\n \n \n </span>\n </a>\n\n \n \n <img class=\"inline-block relative w-6 h-6\" data-ghost-classes=\"bg-color-entity-ghost-background\" data-ghost-url=\"https://static.licdn.com/aero-v1/sc/h/eojn00s72k70vnw5r0xj92t9e\" alt=\"\" aria-busy=\"true\" src=\"https://media.licdn.com/dms/image/v2/D560BAQEa7KMCHz4Brg/company-logo_100_100/company-logo_100_100/0/1720190876396/endorlabs_logo?e=2147483647&v=beta&t=WE6ROU5m3kYdoUIk-3T0aWMiaXJTOtm3zCJUBRA_HYg\">\n \n\n <div class=\"base-main-card__info self-center ml-1 flex-1 relative break-words papabear:min-w-0 mamabear:min-w-0 babybear:w-full\n \">\n<!----> <h3 class=\"base-main-card__title font-sans text-[18px] font-bold text-color-text overflow-hidden\n \n\n Question: What is the role or title sought in this job description?\n Answer:\n "
},
"replies": "The role or title sought in this job description is \"Member of Technical Staff II, Architecture Team.\"",
"total_tokens": 1026,
"input_tokens": 1005,
"output_tokens": 21,
"total_cost": 0.00016335
}
{
"model": "gpt-4o-mini-2024-07-18",
"time": "2025-01-18 23:09:14",
"prompts": {
"prompt_1": "\n You are an expert in extracting specific information from job descriptions. \n Carefully read the job description context below and provide a clear and concise answer to the question.\n\n Context: 377?refId=mehXnFhjZKe%2FmdblvHab5g%3D%3D&trackingId=DZrZGTbh3Rw1sRjlWu7bFQ%3D%3D\" data-tracking-control-name=\"public_jobs_similar-jobs\" data-tracking-client-ingraph=\"\" data-tracking-will-navigate=\"\">\n \n <span class=\"sr-only\">\n \n \n Test Development, Member of Technical Staff\n \n \n </span>\n </a>\n\n \n \n <img class=\"inline-block relative w-6 h-6\" data-ghost-classes=\"bg-color-entity-ghost-background\" data-ghost-url=\"https://static.licdn.com/aero-v1/sc/h/eojn00s72k70vnw5r0xj92t9e\" alt=\"\" aria-busy=\"true\" src=\"https://media.licdn.com/dms/image/v2/C560BAQH3KQPKUVQvgA/company-logo_100_100/company-logo_100_100/0/1662645410444/ii_vi_incorporated_logo?e=2147483647&v=beta&t=5GRdzGXkVVxzU-INidRo4N5e5tVQCqOPk5GTKJGQ8Bs\">\n \n\n <div class=\"base-main-card__info self-center ml-1 flex-1 relative break-words papabear:min-w-0 mamabear:min-w-0 babybear:w-full\n\n\n2FmdblvHab5g%3D%3D&trackingId=SjIkdjVfRAnLZctbKVNN3Q%3D%3D\" data-tracking-control-name=\"public_jobs_similar-jobs\" data-tracking-client-ingraph=\"\" data-tracking-will-navigate=\"\">\n \n <span class=\"sr-only\">\n \n \n Member of Technical Staff II, Architecture Team\n \n \n </span>\n </a>\n\n \n \n <img class=\"inline-block relative w-6 h-6\" data-ghost-classes=\"bg-color-entity-ghost-background\" data-ghost-url=\"https://static.licdn.com/aero-v1/sc/h/eojn00s72k70vnw5r0xj92t9e\" alt=\"\" aria-busy=\"true\" src=\"https://media.licdn.com/dms/image/v2/D560BAQFoizPEFmyakQ/company-logo_100_100/company-logo_100_100/0/1729803311245/illumio_logo?e=2147483647&v=beta&t=mnCq03oIMCGYC-WxVlgM8QMWTI0L0XWfw9iydpPj4jA\">\n \n\n <div class=\"base-main-card__info self-center ml-1 flex-1 relative break-words papabear:min-w-0 mamabear:min-w-0 babybear:w-full\n \">\n<!----> \n\n?refId=mehXnFhjZKe%2FmdblvHab5g%3D%3D&trackingId=U0GVkuPAMkKX0n1r7GuKow%3D%3D\" data-tracking-control-name=\"public_jobs_similar-jobs\" data-tracking-client-ingraph=\"\" data-tracking-will-navigate=\"\">\n \n <span class=\"sr-only\">\n \n \n Member of Technical Staff, AI Data\n \n \n </span>\n </a>\n\n \n \n <img class=\"inline-block relative w-6 h-6\" data-ghost-classes=\"bg-color-entity-ghost-background\" data-ghost-url=\"https://static.licdn.com/aero-v1/sc/h/eojn00s72k70vnw5r0xj92t9e\" alt=\"\" aria-busy=\"true\" src=\"https://media.licdn.com/dms/image/v2/C560BAQFhPajkk8Oypw/company-logo_100_100/company-logo_100_100/0/1662089970627?e=2147483647&v=beta&t=ZkIyJho5at3ZQ6ckKT3KWi5IoEBwJCf7X3vStqvsee8\">\n \n\n <div class=\"base-main-card__info self-center ml-1 flex-1 relative break-words papabear:min-w-0 mamabear:min-w-0 babybear:w-full\n \">\n<!----\n\n Question: What is the company's name?\n Answer:\n "
},
"replies": "The company's name is Illumio.",
"total_tokens": 1042,
"input_tokens": 1033,
"output_tokens": 9,
"total_cost": 0.00016035
}
{
"model": "gpt-4o-mini-2024-07-18",
"time": "2025-01-18 23:09:17",
"prompts": {
"prompt_1": "\n You are an expert in extracting specific information from job descriptions. \n Carefully read the job description context below and provide a clear and concise answer to the question.\n\n Context: 2FmdblvHab5g%3D%3D&trackingId=SjIkdjVfRAnLZctbKVNN3Q%3D%3D\" data-tracking-control-name=\"public_jobs_similar-jobs\" data-tracking-client-ingraph=\"\" data-tracking-will-navigate=\"\">\n \n <span class=\"sr-only\">\n \n \n Member of Technical Staff II, Architecture Team\n \n \n </span>\n </a>\n\n \n \n <img class=\"inline-block relative w-6 h-6\" data-ghost-classes=\"bg-color-entity-ghost-background\" data-ghost-url=\"https://static.licdn.com/aero-v1/sc/h/eojn00s72k70vnw5r0xj92t9e\" alt=\"\" aria-busy=\"true\" src=\"https://media.licdn.com/dms/image/v2/D560BAQFoizPEFmyakQ/company-logo_100_100/company-logo_100_100/0/1729803311245/illumio_logo?e=2147483647&v=beta&t=mnCq03oIMCGYC-WxVlgM8QMWTI0L0XWfw9iydpPj4jA\">\n \n\n <div class=\"base-main-card__info self-center ml-1 flex-1 relative break-words papabear:min-w-0 mamabear:min-w-0 babybear:w-full\n \">\n<!----> \n\n3D\" data-tracking-control-name=\"public_jobs_similar-jobs\" data-tracking-client-ingraph=\"\" data-tracking-will-navigate=\"\">\n \n <span class=\"sr-only\">\n \n \n Member of Technical Staff (Backend)\n \n \n </span>\n </a>\n\n \n \n <img class=\"inline-block relative w-6 h-6\" data-ghost-classes=\"bg-color-entity-ghost-background\" data-ghost-url=\"https://static.licdn.com/aero-v1/sc/h/eojn00s72k70vnw5r0xj92t9e\" alt=\"\" aria-busy=\"true\" src=\"https://media.licdn.com/dms/image/v2/D560BAQEa7KMCHz4Brg/company-logo_100_100/company-logo_100_100/0/1720190876396/endorlabs_logo?e=2147483647&v=beta&t=WE6ROU5m3kYdoUIk-3T0aWMiaXJTOtm3zCJUBRA_HYg\">\n \n\n <div class=\"base-main-card__info self-center ml-1 flex-1 relative break-words papabear:min-w-0 mamabear:min-w-0 babybear:w-full\n \">\n<!----> <h3 class=\"base-main-card__title font-sans text-[18px] font-bold text-color-text overflow-hidden\n \n\n help advance state-of-the-art algorithms for model alignment and develop tools to extend model capabilities to numerous product domains within Microsoft.<br><br>We Are Looking For Candidates Who Are Both Scientists And Software Engineers. The Ideal Candidate Will Be Able To Build Robust Systems That Help Our Team Solve The Next Generation Of AI Problems. They Would<br><br><ul><li>Excel in coding, software engineering, and API design</li><li>Have a background in machine learning and scientific computing</li><li>Thrive in a highly collaborative, fast-paced environment</li><li>Have a high degree of craftsmanship and pay close attention to details</li><li>Effectively manage multiple responsibilities and can adjust to shifting priorities<br><br></li></ul><em>By applying to this U.S. Mountain View, CA OR Redmond, WA position, you are required to be local to the San Francisco area OR Seattle area and in office 3 days a week. <br><br></em>Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.<br><br><strong>Responsibilities<br><br></strong><ul><li>Design and develop the core infrastructure of the RL Platform, focusing on systematizing and extending RL algorithms for LLMs to a variety of present and future environments.</li><li>Assist in development of new algorithms and help onboard other team members to state-of-the-art techniques.</li><li>Collaborate with cross-functional teams to ship new agentic AI product capabilities.</li><li>Embody our culture of collaboration, innovation, and excellence.<br><br></li></ul><strong>Qualifications<br><br></strong><strong>Required Qualifications:<br><br></strong><ul><li>Bachelor's Degree in Computer Science, Software Engineering, Computer Engineering, Machine Learning, Mathematics, or related STEM fields and 4+ years of experience in coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python</li><li>OR equivalent experience.</\n\n Question: What is the job description of the company?\n Answer:\n "
},
"replies": "The job description is for a Member of Technical Staff position focused on backend development within the Architecture Team at Microsoft. The role involves advancing algorithms for model alignment, developing tools for various product domains, and building robust systems to tackle next-generation AI problems. Candidates are expected to excel in coding, software engineering, and API design, have a background in machine learning and scientific computing, and thrive in a collaborative, fast-paced environment. Responsibilities include designing core infrastructure for reinforcement learning (RL) platforms, developing new algorithms, collaborating with cross-functional teams, and promoting a culture of innovation and excellence. Required qualifications include a Bachelor's Degree in a relevant field and at least 4 years of coding experience in various programming languages.",
"total_tokens": 1304,
"input_tokens": 1163,
"output_tokens": 141,
"total_cost": 0.00025905
}