Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Paper • 1908.10084 • Published • 12
This is a sentence-transformers model finetuned from sentence-transformers/all-MiniLM-L6-v2. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
SentenceTransformer(
(0): Transformer({'max_seq_length': 256, 'do_lower_case': False, 'architecture': 'BertModel'})
(1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("zoraizbinsamee/resume-job-matching-sbert")
# Run inference
sentences = [
' clinical service advocate professional summary to be part of an organization which assist and offers services to individuals in need as well as allow me to utilize my past experience and education and offer new challenges as well as growth within the agency skill highlights areas of specialty domestic violence sexual abuse rape prostitution mental health substance abuse depression anxiety bipolar schizophrenia homelessness community inclusion shelter system hra ssi nycha section 8 community resources mental retardation down syndrome medication dispensing residential services autism runaway teenagers adhd add truancy family intervention experience to seek and obtain employment in an organization wich will allow m utilize my past experince skills as well as aqcired sills and ofer new challeges as well as well as offer growth within th organization education and training bachelor of science human services psychology and sociology 2007 boricua college city state ny gpa deans list honor roll student 20062007 and 2008 secretary of the student body and vice president of the research studies latinas take a stand against violence human services psychology and sociology deans list honor roll student 20062007 and 2008 secretary of the student body and vice president of the research studies latina take a stand against violence ad president of women against human trafficking bachelors june 2008 masters degree clinical counseling and psychology human personalities and behaviors clinical counseling and psychology human personalities and behaviors master of science da masters degree i psychology an clinical social work may 2012 city college columbia university city state nyaffiliation awarded three scholarships for academic achievements maintaining a 38 gpa for three consecutive semesters and volunteering work in the communities as well as being recognized for a strong advocate for women in need neon natal as well and or also premature babies born with different types of addictions which required hands on and constant supervision i was offered a position on sept 2014 but i was unable to accept because my passion was so great i could not see myself doing this kind of love labor for money or support i also volunteered from 2006 through 2010 at catholic guardian with clinical manager enid cruz lcsw as a case planner home finder isp development and did many home visits my duties were more than a volunteer for me st barnabas i have volunteered for seven years 2008present in the psych er maternity ward and anywhere needed i have developed a team of interns from both universities i attended columbia and fordham boricua college in one team consisting of 25 where we work with mark cruz senator and directly under the need and supervision of personal mentors ruben diaz sr and jr now jr is the bronx borough president while diaz sr is the hunts point senator service the south bronx area of the bronx giving out resources information to drop in centers centers they can stop by should they need the services over 30 affiliates agencies who work well with homeless dv substance abuse homeless hiv transgender anti violence a date rape coming out support and ways to seek help if desire to get clean even new resources of an agency that preps with mocking interviewed resume prep clothing for the interview and the metrocard if needed and city advocates names numbers district assistance and what they are expected to do for the constituents help with hratanf food stamps ssdi ssi and any form or type of help despite their age color sexual orientation believe or anything we help all the second team consists of 1520 interns who work in the east harlem under the direct supervision and per need of city council president melissa mark vivirito i have also worked with now mayor when he was the citys advocate mr bill di blasio as well as jo serrano who worked with myself and a bunch of student feeding and transporting street homeless adults out of the frigid weather and into shelters for the night or more time if wished needed and as per case to case experience clinical service advocate jul 2015 to jun 2016 company name provided quality services t elderly populations who lives and or resided within their respective homes but were in need of various services or resources available for hem within the community escorted clients as needed to medical appointments psychiatrist housing and any appointments needed to advocate and or inform both parties of any significant events that were taking place or changed during the time from the last visits completed housing application as well as entitlements application letters or document submission discussed any significant events with family doctors service providers social care coordinators and all involved in clients treatment plan womens empowermentcounselor advocate jan 2011 to may 2015 city state provide crisis intervention services to women and their children coming into shelter after leaving their abusive homes facilitated groups for women survivors of domestic violence sexual abuse and incest provided comprehensive services to women and their families in need of outside resources agencies referrals called and scheduled appointments and if needed escorted the clients to these appointments to ensure that language barrier would not be a reason in order to obtain or receive services explored and informed clients who were non english speakers and unaware or little informed of the legal system in the states their rights assisted clients navigate the hra legal boe shelter section 8 nycha affordable housing hasa acs system according to each clients and families needs and situation advocated for clients also providing clients tools skills and insight knowledge on their future independence as women whether it was latinas women of color caucasian or asian always reminding them that their worth was important and that they can achieve their highest level of potential office manager aug 2008 to dec 2011 company name city state handled all incomingoutgoing calls from office to different court parts das offices judges chambers and clients being represented either by the lawyer or the bail bond agent assisted clients in completing any or all documentationforms for their cases files as needed in order to provide a more accurate or better quality of service during the visit followed up on any pending cases as well as composed legal documentations for both lawyer and bail bond agent at times translating these documents from english to spanish and vice versa served as an interpreter for nonenglish speaking clients who were in need of legal consultation or came by the office to follow on their pending case composed disposition letters adjournments minutesnotes legal summaries court hearings request appearances subpoenas witness presence or any legal documents requested by attorneys or agents handled all office banking rental fees and office space charges cash payments from clients lawyers and tenants etc performed online banking using bank application and made all deposits and withdrawals as per request of lawyer responsible for making all payments for the office bills bilingual clinical services coordinator nov 2005 to jul 2009 company name city state coordinated and provided communitybased services utilizing any and all resources available within the community to assist our clients living with a substance abuse addiction mental illness homelessness and criminal history ensured service plans suited each clients specific need according to their mental illness substance abuse history as well as addressed any other stressors in order to facilitate clients reintegration in the community and assisting and allowing them to become productive members in our society facilitated encouraged and prompted clients to be part of the na aa ga sa meetings promoting a healthy drug free lifestyle and enhance their quality of life always reminding them of the importance of focusing on their goals and working a program that best suited their recovery counseled clients individually family setting and in groups as needed and requested by clients providing a 24 hour crisis intervention using cellular provided by the agency worked well within a team setting or individually for an act team assertive community treatment where 80 of the services were provided within the community under the rules and regulation of oasas omh doh dept of health samhsa hra nycha section 8 as well as resources government offices and referring one stop organizations or agencies that provided assistance for clients advocated at state and local events reminding the politicians congress senators and assembly of the importance of public state city and private funding to continue providing services in district implemented goals that were realistic and tailored by the clients daily documentation of any progress updates changes of services or significant events were documents for a caseload of 1624 clients documentation was completed and submitted within a timely manner skills psychology human behavior and personality disorder academic various agencies worked and volunteered and interned fr mayor bill di blasio cit advocate leticia james bronx congress jose senarator epillat upper manhattan cases reintegration from jail system back into the communitiesreintegration worked with autism down syndrome mentally ill mentaly retarded group homes a risk youth human traffickerwhile doing office administration for both legal team of criminal lawyers as well as well as non for profit administration i did online banking fund raising consultationknowledge experience and worked along side side congress workers such as ruben diaz sr in the south bronx area where many low income super low income many in he shelter system unemployed many residing in shelter system due to poverty ad lack of income or jobs available or lack of education opportunities resources or chances to excel also worked along side and closely to the mr ruben diaz jr bronx borough president where i with became eager to follow and make change with in he bronx where i personally as raised in the bronx and fell prod to say i am a bromxite wwit ard work abo and ooprtniies attendeded and radated frm columbia university and bronxite congress created and became the bronx workforce 1 i was pivotal part of all the new and availablle proarmas aha where programs for education training jobs scholarships college prep and class part of the workfoce 1 program for the and at the dept of labor a new program which opened doors for all bronxites chances opportunities and a new style of life to learn live and enjoy a new form of a style of live gainfully employed ending homeless most people or potential candidates with no experience to now becoming prepared gaining new set of specific skills and prepared for todays competitive market in nyc in my opinion it rescued many bronxite which went from no set of skills to now having the ability to get education training jobs and opportunities to better themselvesor educate in areas of their choice many councilcongress and people with power took interest n helping ut th bronx in the map where we belonged and help the bcx boroughs quickly became involvement part took in the bronxs crisis intervention something i know all to well from my personal work educational and professional life worked outreach act team institutionalized hospital and accessed he transition from hospital to client discharge back t he community assist with entitlements benefits ssissd food stamps housing medicaid nycha shelter plus care ect assist ad promote clients independence and doh dv documentation english forms government guardian isp legal legal documents letters notes mark meetings mental health mental illness money office progress psychiatrist speaking quality spanish ssi supervision translating treatment plan type ad services needed according to specific individual need and assessment individual and according to individual need and basis ',
'govcio is currently hiring for a data scientist sme to provide support at rock island il responsibilities perform advanced analysis and analytics to produce algorithms andor business process recommendations develop and use data algorithms and analyses to identify and apply mechanisms to both overcome impediments to materiel readiness and exploit opportunities to improve readiness through feasible costeffective software and business process improvements changes and interventions forecast and address complex analytical challenges and identify the challenges and opportunities within systems develop comprehensive solutions and incorporate these capabilities solutions into software and workflows develop analytics and process solution sets the criteria for recommended algorithms and processes shall include preference for efficient methods that use as simple of a process as possible given the current stateoftheart practices the analytics and process solution sets shall provide appropriate economic savingsdriven answers regularly identify and communicate courses of actions required for program and project success including appropriate reporting processes and applicable metrics to monitor and assess outcomes proactively identify mechanisms to improve mission performance use appropriate quantitative analytics techniques to include time series analysis and forecasting advanced multivariate regression including probit and logit models systems dynamics modelling bayesian inference procedures minimax procedures statistical subjective probability utilization expected utility analysis operational risk analysis and uncertainty evaluation use appropriate qualitative analytics techniques to include multicriteria decision analysis qualitative comparative analysis causal mapping formal game theory minimax procedures game theory decision architecture systems architecture analysis organizational analysis and structural reform supply chain analysis and multinational best practices military and industry evaluation use logistics and agentbased modeling and simulation conduct business process analysis and optimization across the doctrine organization training materiel leadership education personnel facilities policy dotmlpfp spectrum and beyond produce formal use cases software program change requests and other required documentation for technology insertion into related defense logistics support software interface and liaise with software program offices and contractors develop requirements for defense analytics software conduct stakeholder analysis and create products for stakeholder communications and messaging qualifications bachelors with 12 years or commensurate experience required skills and experience minimum 8 years of experience working directly on a data science team masters degree in data science mathematics statistics economics computer science engineering or other related business or quantitative discipline is required experience working with tools including objectoriented programming python java computational analysis tools r matlab and associated data science libraries scikitlearn experience creating meaningful data visualizations and interactive dashboards using platforms such as tableau qlik power bi rshiny plotly and d3js to communicate findings and relate them back to how your insights create business impact working knowledge of databases and sql preferred qualifications include linking analytic and data visualization products to database connections superior communication skills both oral and written data science methods related to data architecture data munging data and feature engineering and predictive analytics unstructured text and natural language processing r python sas or matlab anaconda ibm blue and oracle big data to analyze large data sets and develop automated analytics in making sense of data affecting dod operations developing machine learning data mining statistical network natural language processing text analytics and graphbased algorithms to analyze massive data sets supervising algorithm implementation in on premise and cloudbased computing environments developing software to generate reports and visualizations that summarize data sets and provide datadriven insights developing and implementing statistical machine learning and heuristic techniques to create descriptive predictive and prescriptive analytics as well as to develop statistical tests to make datadriven recommendations and decisions preferred skills and experience clearance required none pending contract award company overview govcio is a team of transformerspeople who are passionate about transforming government it every day we make a positive impact by delivering innovative it services and solutions that improve how government agencies operate and serve our citizens but we cant do it alone we need great people to help us do great things for our customers our culture and our ability to attract other great people we are changing the face of government it and building a workforce that fuels this mission are you ready to be a transformer we are an equal opportunity employer all qualified applicants will receive consideration for employment without regard to race color religion sex gender gender identity or expression sexual orientation national origin disability or status as a protected veteran eoe including disabilityvets posted pay range the posted pay range if referenced reflects the range expected for this position at the commencement of employment however base pay offered may vary depending on multiple individualized factors including market location jobrelated knowledge skills education experience and internal equity the total compensation package for this position may also include other compensation elements to be discussed during the hiring process if hired employee will be in an atwill position and the govcio reserves the right to modify base salary as well as any other discretionary payment or compensation program at any time including for reasons related to individual performance govcio or individual departmentteam performance and market factors posted salary range usd 10647780 usd 11159148 yr show more show less data scientist algorithms business process recommendations data analysis software development systems dynamics modelling bayesian inference procedures minimax procedures statistical subjective probability utilization expected utility analysis operational risk analysis uncertainty evaluation multicriteria decision analysis qualitative comparative analysis causal mapping formal game theory minimax procedures game theory decision architecture systems architecture analysis organizational analysis structural reform supply chain analysis multinational best practices military and industry evaluation logistics and agentbased modeling and simulation business process analysis and optimization use cases software program change requests software insertion stakeholder analysis data science team experience python java r matlab scikitlearn tableau qlik power bi rshiny plotly d3js databases sql data architecture data munging data and feature engineering predictive analytics unstructured text natural language processing machine learning data mining statistical network text analytics graphbased algorithms algorithm implementation datadriven insights statistical tests heuristic techniques descriptive analytics predictive analytics prescriptive analytics dod operations anaconda ibm blue oracle big data',
'our mission our mission is to solve the most important and fundamental challenges in ai and robotics to enable future generations of intelligent machines that will help us all live better lives data engineers will work crossfunctionally creating new technology to improve software development for robots if you have a passion for developing technology for robots and use it to advance their capabilities and usefulness you will want to join us we are onsite in our new cambridge ma office where we are building a collaborative and exciting new organization responsibilities work collaboratively with research scientists and software engineers on software development for a range of different robotic platforms develop and maintain our data warehouses and data pipelines in cloud and onpremise infrastructurebuild event and batch driven ingestion systems for machine learning and rd as needed develop and administer databases knowledge bases and distributed data stores create and use systems to clean integrate or fuse datasets to produce data products establish and monitor data integrity and value through visualization profiling and statistical tools perform updates migrations and administration tasks for data systems develop and implement a data governance data retention strategyuse python and sql to develop maintain and scale our data stores requirements bsms in computer science robotics or a related field 10 years of experience in a data engineering or similar role demonstrated experience with a variety of relational database and data warehousing technology such as aws redshift athena rds bigquery demonstrated experience with big data processing systems and distributed computing technology such as databricks spark sagemaker kafka etc strong experience with etl design and implementations in the context of large multimodal and distributed datasets bonus not required 5 years experience with distributed datacomputing tools mapreduce hadoop hive emr kafka spark gurobi or mysql 5 year experience working on realtime data and streaming applications 5 years of experience with nosql implementation mongo cassandra2 years of experience with airflow 5 years of data warehousing experience redshift or snowflake 5 years of experience with unixlinux including basic commands and shell scripting we provide equal employment opportunities to all employees and applicants for employment and prohibit discrimination and harassment of any type without regard to race color religion age sex national origin disability status genetics protected veteran status sexual orientation gender identity or expression or any other characteristic protected by federal state or local laws show more show less python sql relational database data warehousing aws redshift athena rds bigquery big data processing systems distributed computing databricks spark sagemaker kafka etl design hadoop hive emr mysql nosql mongodb cassandra airflow unixlinux',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.9136, 0.5523],
# [0.9136, 1.0000, 0.6603],
# [0.5523, 0.6603, 1.0000]])
sentence_0, sentence_1, and label| sentence_0 | sentence_1 | label | |
|---|---|---|---|
| type | string | string | float |
| details |
|
|
|
| sentence_0 | sentence_1 | label |
|---|---|---|
ep high school english and language arts teacher professional summary licensed english teacher and k12 school administrator experienced in designing and implementing programs and developing curriculum to help students achieve academic goals and prepare for career interests skilled in creating flexible programming and specialized learning experiences that embody mission vision and strategic direction of educational institution skills student records management differentiated instruction classroom management group and individual instruction conflict resolution techniques lesson planning analytical skills flexible adaptable supervision interpersonal communication work history 082018 to current high school english and language arts teacher company name city state continually improve instruction to ensure academic growth collaborate with faculty and community members to improve education and... |
software resources has an immediate job opportunity for a lead data platform engineer with a major corporation in bristol ct other locations where candidates can be located are santa monica glendale burbank san francisco seattle nyc orlando candidates must be able to be on site 4 days a week and 1 day remote duration 18 months job description efforts to ensure users keep coming back to their favorite apps we can also create heat maps to better understand how people are using our applications finally this data helps drive the creation of new content so that more and more continue to come back to our powerful brands as a lead data platform engineer youll be responsible for building and maintaining a backend that can handle billions of events per week youll work closely with the sdk teams and product owner to build solutions that ensure data quality and reliability youll be given the autonomy and freedom to lead and guide backend architecture and processes responsibilities and duties of ... |
0.0 |
executive chef summary outgoing job title offering extensive knowledge of hospitality etiquette food preparation and superior customer servicefood service professional and culinary arts student seeking a position in an elegant fine dining establishment extensive knowledge of highend ingredients and food and wine pairingsrestaurant professional with number years in foh and boh operations customer service and food handling expertise skilled at memorizing menu items and ordersorganized independent worker with strong time management skills detailoriented and able to learn new tasks quickly and effectivelyorganized independent worker with strong time management skills detailoriented and able to learn new tasks quickly and effectivelyefficient job title with strong interpersonal and coaching skills prior work in busy hotels and finddining restaurantsserver bringing enthusiasm dedication and an exceptional work ethic trained in customer service with knowledge of cuisine typ... |
title machine learning engineer location sunnyvale ca duration 12 months qualifications skill sets niche skill experience preference machine learning yes at least 1 year is required natural language processing no at least 1 year is required python no at least 1 year is required show more show less machine learning natural language processing python |
1.0 |
customer service rep career focus to find a long term career that is enjoyable and a great place to work being able to support a family is a big plus as well core qualifications operations management natural leader proficiency in management and weapons training aircraft safety proficient communicator quick learner motivated computer proficient background checks microsoft office strong analytical skills filerecords maintenance excellent problem solving skills reports generation and analysis change management financial records and processing first aid training 2014 training and development aed training 2014 superior customer service diagnosis and repair mathematical aptitude preventative maintenance employee relations specialist service solutions expert dedicated to process improvement conflict resolution proficiency ... |
company description jobs for humanity is partnering with capital one to build an inclusive and just employment ecosystem therefore we prioritize individuals coming from the following communities refugee neurodivergent single parent blind or low vision deaf or hard of hearing black hispanic asian military veterans the elderly the lgbtq and justice impacted individuals this position is open to candidates who reside in and have the legal right to work in the country where the job is located company name capital one job description lead data engineer job opportunity are you someone who enjoys working with technology and solving complex problems do you thrive in a collaborative and inclusive environment at capital one we are a diverse group of innovators who are passionate about using data and emerging technologies to meet customer needs we are currently looking for talented data engineers to join our team and be a part of driving transformation within capital one what youll do collaborate... |
0.0 |
CosineSimilarityLoss with these parameters:{
"loss_fct": "torch.nn.modules.loss.MSELoss"
}
per_device_train_batch_size: 16per_device_eval_batch_size: 16num_train_epochs: 30multi_dataset_batch_sampler: round_robindo_predict: Falseeval_strategy: noprediction_loss_only: Trueper_device_train_batch_size: 16per_device_eval_batch_size: 16gradient_accumulation_steps: 1eval_accumulation_steps: Nonetorch_empty_cache_steps: Nonelearning_rate: 5e-05weight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08max_grad_norm: 1num_train_epochs: 30max_steps: -1lr_scheduler_type: linearlr_scheduler_kwargs: Nonewarmup_ratio: Nonewarmup_steps: 0log_level: passivelog_level_replica: warninglog_on_each_node: Truelogging_nan_inf_filter: Trueenable_jit_checkpoint: Falsesave_on_each_node: Falsesave_only_model: Falserestore_callback_states_from_checkpoint: Falseuse_cpu: Falseseed: 42data_seed: Nonebf16: Falsefp16: Falsebf16_full_eval: Falsefp16_full_eval: Falsetf32: Nonelocal_rank: -1ddp_backend: Nonedebug: []dataloader_drop_last: Falsedataloader_num_workers: 0dataloader_prefetch_factor: Nonedisable_tqdm: Falseremove_unused_columns: Truelabel_names: Noneload_best_model_at_end: Falseignore_data_skip: Falsefsdp: []fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}parallelism_config: Nonedeepspeed: Nonelabel_smoothing_factor: 0.0optim: adamw_torch_fusedoptim_args: Nonegroup_by_length: Falselength_column_name: lengthproject: huggingfacetrackio_space_id: trackioddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falsedataloader_pin_memory: Truedataloader_persistent_workers: Falseskip_memory_metrics: Truepush_to_hub: Falseresume_from_checkpoint: Nonehub_model_id: Nonehub_strategy: every_savehub_private_repo: Nonehub_always_push: Falsehub_revision: Nonegradient_checkpointing: Falsegradient_checkpointing_kwargs: Noneinclude_for_metrics: []eval_do_concat_batches: Trueauto_find_batch_size: Falsefull_determinism: Falseddp_timeout: 1800torch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Noneinclude_num_input_tokens_seen: noneftune_noise_alpha: Noneoptim_target_modules: Nonebatch_eval_metrics: Falseeval_on_start: Falseuse_liger_kernel: Falseliger_kernel_config: Noneeval_use_gather_object: Falseaverage_tokens_across_devices: Trueuse_cache: Falseprompts: Nonebatch_sampler: batch_samplermulti_dataset_batch_sampler: round_robinrouter_mapping: {}learning_rate_mapping: {}| Epoch | Step | Training Loss |
|---|---|---|
| 1.7921 | 500 | 0.2524 |
| 3.5842 | 1000 | 0.2293 |
| 5.3763 | 1500 | 0.2047 |
| 7.1685 | 2000 | 0.1777 |
| 8.9606 | 2500 | 0.1515 |
| 10.7527 | 3000 | 0.1249 |
| 12.5448 | 3500 | 0.1043 |
| 14.3369 | 4000 | 0.0874 |
| 16.1290 | 4500 | 0.0744 |
| 17.9211 | 5000 | 0.0638 |
| 19.7133 | 5500 | 0.0550 |
| 21.5054 | 6000 | 0.0505 |
| 23.2975 | 6500 | 0.0444 |
| 25.0896 | 7000 | 0.0414 |
| 26.8817 | 7500 | 0.0383 |
| 28.6738 | 8000 | 0.0350 |
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
Base model
sentence-transformers/all-MiniLM-L6-v2