Conference Paper/Proceeding/Abstract 699 views 440 downloads
Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation
Deshan Sumanathilaka 
,
Nicholas Micallef ,
Julian Hough
,
Nicholas Micallef ,
Julian Hough
NLPAICS 2024 : First International Conference on Natural Language Processing and Artificial Intelligence for Cyber Security, Pages: 97 - 108
Swansea University Authors:
Deshan Sumanathilaka , Nicholas Micallef , Julian Hough
-
PDF | Accepted Manuscript
Author accepted manuscript document released under the terms of a Creative Commons CC-BY licence using the Swansea University Research Publications Policy (rights retention).
Download (440.34KB)
Abstract
Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation
| first_indexed |
2024-10-07T12:17:52Z |
|---|---|
| last_indexed |
2024-11-25T14:21:05Z |
| id |
cronfa67920 |
| recordtype |
SURis |
| fullrecord |
<?xml version="1.0"?><rfc1807><datestamp>2024-11-05T13:55:40.5285966</datestamp><bib-version>v2</bib-version><id>67920</id><entry>2024-10-07</entry><title>Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation</title><swanseaauthors><author><sid>2fe44f0c1e7d845dc21bb6b00d5b2085</sid><ORCID>0009-0005-8933-6559</ORCID><firstname>Deshan</firstname><surname>Sumanathilaka</surname><name>Deshan Sumanathilaka</name><active>true</active><ethesisStudent>false</ethesisStudent></author><author><sid>1cc4c84582d665b7ee08fb16f5454671</sid><ORCID>0000-0002-2683-8042</ORCID><firstname>Nicholas</firstname><surname>Micallef</surname><name>Nicholas Micallef</name><active>true</active><ethesisStudent>false</ethesisStudent></author><author><sid>082d773ae261d2bbf49434dd2608ab40</sid><ORCID>0000-0002-4345-6759</ORCID><firstname>Julian</firstname><surname>Hough</surname><name>Julian Hough</name><active>true</active><ethesisStudent>false</ethesisStudent></author></swanseaauthors><date>2024-10-07</date><deptcode>MACS</deptcode><abstract/><type>Conference Paper/Proceeding/Abstract</type><journal>NLPAICS 2024 : First International Conference on Natural Language Processing and Artificial Intelligence for Cyber Security</journal><volume/><journalNumber/><paginationStart>97</paginationStart><paginationEnd>108</paginationEnd><publisher/><placeOfPublication/><isbnPrint/><isbnElectronic/><issnPrint/><issnElectronic/><keywords/><publishedDay>29</publishedDay><publishedMonth>10</publishedMonth><publishedYear>2024</publishedYear><publishedDate>2024-10-29</publishedDate><doi/><url/><notes/><college>COLLEGE NANME</college><department>Mathematics and Computer Science School</department><CollegeCode>COLLEGE CODE</CollegeCode><DepartmentCode>MACS</DepartmentCode><institution>Swansea University</institution><apcterm/><funders/><projectreference/><lastEdited>2024-11-05T13:55:40.5285966</lastEdited><Created>2024-10-07T10:37:38.0814827</Created><path><level id="1">Faculty of Science and Engineering</level><level id="2">School of Mathematics and Computer Science - Computer Science</level></path><authors><author><firstname>Deshan</firstname><surname>Sumanathilaka</surname><orcid>0009-0005-8933-6559</orcid><order>1</order></author><author><firstname>Nicholas</firstname><surname>Micallef</surname><orcid>0000-0002-2683-8042</orcid><order>2</order></author><author><firstname>Julian</firstname><surname>Hough</surname><orcid>0000-0002-4345-6759</orcid><order>3</order></author></authors><documents><document><filename>67920__32544__d53f473860734c5e99177c26a2ee55d3.pdf</filename><originalFilename>NLPAICS.pdf</originalFilename><uploaded>2024-10-07T12:42:27.1083525</uploaded><type>Output</type><contentLength>450910</contentLength><contentType>application/pdf</contentType><version>Accepted Manuscript</version><cronfaStatus>true</cronfaStatus><documentNotes>Author accepted manuscript document released under the terms of a Creative Commons CC-BY licence using the Swansea University Research Publications Policy (rights retention).</documentNotes><copyrightCorrect>true</copyrightCorrect><language>eng</language><licence>https://creativecommons.org/licenses/by/4.0/deed.en</licence></document></documents><OutputDurs/></rfc1807> |
| spelling |
2024-11-05T13:55:40.5285966 v2 67920 2024-10-07 Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation 2fe44f0c1e7d845dc21bb6b00d5b2085 0009-0005-8933-6559 Deshan Sumanathilaka Deshan Sumanathilaka true false 1cc4c84582d665b7ee08fb16f5454671 0000-0002-2683-8042 Nicholas Micallef Nicholas Micallef true false 082d773ae261d2bbf49434dd2608ab40 0000-0002-4345-6759 Julian Hough Julian Hough true false 2024-10-07 MACS Conference Paper/Proceeding/Abstract NLPAICS 2024 : First International Conference on Natural Language Processing and Artificial Intelligence for Cyber Security 97 108 29 10 2024 2024-10-29 COLLEGE NANME Mathematics and Computer Science School COLLEGE CODE MACS Swansea University 2024-11-05T13:55:40.5285966 2024-10-07T10:37:38.0814827 Faculty of Science and Engineering School of Mathematics and Computer Science - Computer Science Deshan Sumanathilaka 0009-0005-8933-6559 1 Nicholas Micallef 0000-0002-2683-8042 2 Julian Hough 0000-0002-4345-6759 3 67920__32544__d53f473860734c5e99177c26a2ee55d3.pdf NLPAICS.pdf 2024-10-07T12:42:27.1083525 Output 450910 application/pdf Accepted Manuscript true Author accepted manuscript document released under the terms of a Creative Commons CC-BY licence using the Swansea University Research Publications Policy (rights retention). true eng https://creativecommons.org/licenses/by/4.0/deed.en |
| title |
Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation |
| spellingShingle |
Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation Deshan Sumanathilaka Nicholas Micallef Julian Hough |
| title_short |
Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation |
| title_full |
Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation |
| title_fullStr |
Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation |
| title_full_unstemmed |
Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation |
| title_sort |
Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation |
| author_id_str_mv |
2fe44f0c1e7d845dc21bb6b00d5b2085 1cc4c84582d665b7ee08fb16f5454671 082d773ae261d2bbf49434dd2608ab40 |
| author_id_fullname_str_mv |
2fe44f0c1e7d845dc21bb6b00d5b2085_***_Deshan Sumanathilaka 1cc4c84582d665b7ee08fb16f5454671_***_Nicholas Micallef 082d773ae261d2bbf49434dd2608ab40_***_Julian Hough |
| author |
Deshan Sumanathilaka Nicholas Micallef Julian Hough |
| author2 |
Deshan Sumanathilaka Nicholas Micallef Julian Hough |
| format |
Conference Paper/Proceeding/Abstract |
| container_title |
NLPAICS 2024 : First International Conference on Natural Language Processing and Artificial Intelligence for Cyber Security |
| container_start_page |
97 |
| publishDate |
2024 |
| institution |
Swansea University |
| college_str |
Faculty of Science and Engineering |
| hierarchytype |
|
| hierarchy_top_id |
facultyofscienceandengineering |
| hierarchy_top_title |
Faculty of Science and Engineering |
| hierarchy_parent_id |
facultyofscienceandengineering |
| hierarchy_parent_title |
Faculty of Science and Engineering |
| department_str |
School of Mathematics and Computer Science - Computer Science{{{_:::_}}}Faculty of Science and Engineering{{{_:::_}}}School of Mathematics and Computer Science - Computer Science |
| document_store_str |
1 |
| active_str |
0 |
| published_date |
2024-10-29T05:24:03Z |
| _version_ |
1851097605211160576 |
| score |
11.089386 |