Implementation of Agent Systems in Big Data Management: Integrating Artificial Intelligence for Data Mining Optimization
Article Sidebar
-
Agent Systems, Artificial Intelligence, Big Data, Data Mining, Data Management, Optimization
Abstract
Background: The rapid growth of data generated across various domains necessitates advanced methodologies for effective data management and extraction of meaningful insights. Traditional data processing techniques often struggle with the volume, variety, and velocity of big data. The integration of Agent Systems and Artificial Intelligence (AI) presents a promising approach to address these challenges by enhancing the efficiency and effectiveness of data mining processes.
Objective: This study aims to explore the implementation of Agent Systems in big data management, focusing on how the integration of AI can optimize data mining operations. By leveraging the capabilities of intelligent agents, we seek to improve the accuracy, speed, and scalability of data analysis.
Methods: A hybrid research methodology was employed, combining a systematic literature review with an empirical case study. The literature review analyzed previous research on Agent Systems, AI, and big data management to identify key trends and challenges. The empirical case study involved deploying an AI-integrated Agent System within a large-scale data environment to evaluate its performance. Key performance indicators (KPIs) such as processing time, accuracy, and scalability were measured and analyzed.
Results: The findings indicate that the integration of AI within Agent Systems significantly enhances the data mining process. The system demonstrated a reduction in processing time by 40%, an increase in data analysis accuracy by 25%, and improved scalability, handling larger datasets more efficiently compared to traditional methods. These improvements were attributed to the autonomous and adaptive nature of agent systems, which enabled dynamic data processing and real-time decision-making.
Conclusion: The study concludes that the implementation of AI-integrated Agent Systems in big data management offers substantial benefits, including optimized data mining performance. This integration facilitates more efficient and effective data analysis, which is crucial for organizations dealing with large volumes of data. Future research should focus on further refining these systems and exploring their application across different sectors.
Full text article
References
Afanasyev, V. (2022). Advanced information technology for development of electric power market. International Journal of Advanced Manufacturing Technology, 118(1), 119–127. https://doi.org/10.1007/s00170-021-07324-8
Agrawal, A. (2019). Spare: Spiking neural network acceleration using rom-embedded rams as in-memory-computation primitives. IEEE Transactions on Computers, 68(8), 1190–1200. https://doi.org/10.1109/TC.2018.2867048
Ahearne, S. (2023). An AI Factory Digital Twin Deployed Within a High Performance Edge Architecture. Proceedings - International Conference on Network Protocols, ICNP, Query date: 2024-08-21 13:52:51. https://doi.org/10.1109/ICNP59255.2023.10355613
Alamäki, A. (2019). Interactive Machine Learning: Managing Information Richness in Highly Anonymized Conversation Data. IFIP Advances in Information and Communication Technology, 568(Query date: 2024-08-21 13:52:51), 173–184. https://doi.org/10.1007/978-3-030-28464-0_16
Ali, M. K. (2023). Exploring the multifunctional roles of quantum dots for unlocking the future of biology and medicine. Environmental Research, 232(Query date: 2024-08-21 13:52:51). https://doi.org/10.1016/j.envres.2023.116290
Amrina, Mudinillah, A., & Handayani, E. P. (2021). Pemanfaatan Aplikasi Canva dalam Proses Pembelajaran Bahasa Arab di MAN Gunung Padang Panjang. Tarbiyatuna: Jurnal Pendidikan Ilmiah, 6(2), 101–116. https://doi.org/10.55187/tarjpi.v6i2.4519
Ashton, H. (2020). AI Legal Counsel to train and regulate legally constrained Autonomous systems. Proceedings - 2020 IEEE International Conference on Big Data, Big Data 2020, Query date: 2024-08-21 13:52:51, 2093–2098. https://doi.org/10.1109/BigData50022.2020.9378389
Bretz, F. (2023). The Role of Statistical Thinking in Biopharmaceutical Research. Statistics in Biopharmaceutical Research, 15(3), 458–467. https://doi.org/10.1080/19466315.2023.2224259
Caioni, G. (2023). Personal Care Products as a Contributing Factor to Antimicrobial Resistance: Current State and Novel Approach to Investigation. Antibiotics, 12(4). https://doi.org/10.3390/antibiotics12040724
Candrian, C. (2022). Rise of the machines: Delegating decisions to autonomous AI. Computers in Human Behavior, 134(Query date: 2024-08-21 13:52:51). https://doi.org/10.1016/j.chb.2022.107308
Duarte-Rojo, A. (2022). Artificial Intelligence and the Risk for Intuition Decline in Clinical Medicine. American Journal of Gastroenterology, 117(3), 401–402. https://doi.org/10.14309/ajg.0000000000001618
Gao, Y. (2021). Status and prospect of key technologies of intelligentization of fully-mechanized coal mining face. Meitan Kexue Jishu/Coal Science and Technology (Peking), 49(8), 1–22. https://doi.org/10.13199/j.cnki.cst.2021.08.001
García, N. M. (2019). Multi-agent system for anomaly detection in Industry 4.0 using Machine Learning techniques. Advances in Distributed Computing and Artificial Intelligence Journal, 8(4), 33–40. https://doi.org/10.14201/ADCAIJ2019843340
Grum, M. (2020). Managing human and artificial knowledge bearers: The creation of a symbiotic knowledge management approach. Lecture Notes in Business Information Processing, 391(Query date: 2024-08-21 13:52:51), 182–201. https://doi.org/10.1007/978-3-030-52306-0_12
Haji, E. E. (2020). Proposal of a digital ecosystem based on big data and artificial intelligence to support educational and vocational guidance. International Journal of Modern Education and Computer Science, 12(4), 1–11. https://doi.org/10.5815/ijmecs.2020.04.01
Han, Y. (2021). Overview of therapeutic potentiality of Angelica sinensis for ischemic stroke. Phytomedicine, 90(Query date: 2024-08-21 13:52:51). https://doi.org/10.1016/j.phymed.2021.153652
Housley, W. (2019). Natural action processing conversation analysis and big interactional data. ACM International Conference Proceeding Series, Query date: 2024-08-21 13:52:51. https://doi.org/10.1145/3363384.3363478
Hu, J. (2020). Application of deep reinforcement learning in the board game. Proceedings of 2020 IEEE International Conference on Information Technology, Big Data and Artificial Intelligence, ICIBA 2020, Query date: 2024-08-21 13:52:51, 809–812. https://doi.org/10.1109/ICIBA50161.2020.9277188
Ikhlas, R. Z., Japakiya, R., & Muzayanah, T. (2023). Utilization of Canva Application as a Learning Media Video Creation. Journal of Social Science Utilizing Technology, 1(3), 158–169. https://doi.org/10.55849/jssut.v1i3.558
Ivanov, D. (2021). Researchers’ perspectives on Industry 4.0: Multi-disciplinary analysis and opportunities for operations management. International Journal of Production Research, 59(7), 2055–2078. https://doi.org/10.1080/00207543.2020.1798035
Jang, H. (2021). Deep Q-network-based multi-criteria decision-making framework for virtual simulation environment. Neural Computing and Applications, 33(17), 10657–10671. https://doi.org/10.1007/s00521-020-04918-3
Jayasekara, C. (2023). Artificial Intelligence Agent to Identify the Correct Human Resources. ICAC 2023 - 5th International Conference on Advancements in Computing: Technological Innovation for a Sustainable Economy, Proceedings, Query date: 2024-08-21 13:52:51, 424–429. https://doi.org/10.1109/ICAC60630.2023.10417197
Karouani, Y. (2022). Milk-run collection monitoring system using the internet of things based on swarm intelligence. International Journal of Information Systems and Supply Chain Management, 15(3). https://doi.org/10.4018/IJISSCM.290018
Kuai, H. (2023). Thinking space generation using context-enhanced knowledge fusion for systematic brain computing. Web Intelligence, 21(4), 345–361. https://doi.org/10.3233/WEB-220089
Kuang, M. (2022). Development of artificial intelligence system for ideological and political education in colleges and universities. Proceedings - 2022 3rd International Conference on Education, Knowledge and Information Management, ICEKIM 2022, Query date: 2024-08-21 13:52:51, 235–238. https://doi.org/10.1109/ICEKIM55072.2022.00059
Li, S. (2023). Research and development practice of traditional Chinese medicine based on network target theory and technology. Zhongguo Zhongyao Zazhi, 48(22), 5965–5976. https://doi.org/10.19540/j.cnki.cjcmm.20230923.701
Liu, Z. (2020). Second-Generation Sequencing with Deep Reinforcement Learning for Lung Infection Detection. Journal of Healthcare Engineering, 2020(Query date: 2024-08-21 13:52:51). https://doi.org/10.1155/2020/3264801
Medvei, M. M. (2021). Approaching traffic congestion with Double Deep Q-Networks. Proceedings - RoEduNet IEEE International Conference, 2021(Query date: 2024-08-21 13:52:51). https://doi.org/10.1109/RoEduNet54112.2021.9638310
Mudinillah, A., & Rizaldi, M. (2021). Using the Canva Application as an Arabic Learning Media at SMA Plus Panyabungan. At-Tasyrih: jurnal pendidikan dan hukum Islam, 7(2), 95–106. https://doi.org/10.55849/attasyrih.v7i2.67
Paolucci, F. (2022). Peer-to-peer disaggregated telemetry for autonomic machine-learning-driven transceiver operation. Journal of Optical Communications and Networking, 14(8), 606–620. https://doi.org/10.1364/JOCN.456666
Patry, H., Kadir, M. A., & Ritonga, A. R. F. (2023). Utilisation of Kinemaster Application as Thematic Learning Media Development in Elementary School. Journal of Social Science Utilizing Technology, 1(3), 115–128. https://doi.org/10.55849/jssut.v1i3.568
Ramesh, Y. (2020). An artificial intelligence approach to social networks agent task scheduling analysis in map-reduce for sentiment opinion analysis. Proceedings - 2020 IEEE International Symposium on Sustainable Energy, Signal Processing and Cyber Security, iSSSC 2020, Query date: 2024-08-21 13:52:51. https://doi.org/10.1109/iSSSC50941.2020.9358825
Reuter, L. (2019). Intentional Forgetting in Distributed Artificial Intelligence. KI - Kunstliche Intelligenz, 33(1), 69–77. https://doi.org/10.1007/s13218-018-0566-4
Salam, A. R. (2019). Features and teaching/learning activities used in educational android mobile applications to teach quranic arabic vocabulary. International Journal of Engineering and Advanced Technology, 8(5), 1184–1187. https://doi.org/10.35940/ijeat.E1167.0585C19
Serrano-Santoyo, A. (2021). Ethical implications regarding the adoption of emerging digital technologies: An exploratory framework. Progress in Ethical Practices of Businesses: A Focus on Behavioral Interactions, Query date: 2024-08-21 13:52:51, 219–239. https://doi.org/10.1007/978-3-030-60727-2_12
Shaikh, T. A. (2023). Machine intelligence and medical cyber-physical system architectures for smart healthcare: Taxonomy, challenges, opportunities, and possible solutions. Artificial Intelligence in Medicine, 146(Query date: 2024-08-21 13:52:51). https://doi.org/10.1016/j.artmed.2023.102692
Sharifmousavi, M. (2024). Distributed Artificial Intelligence Application in Agri-food Supply Chains 4.0. Procedia Computer Science, 232(Query date: 2024-08-21 13:52:51), 211–220. https://doi.org/10.1016/j.procs.2024.01.021
Wang, X. (2020). Spatio-temporal semantic analysis of safety production accidents in grain depot based on natural language processing. Proceedings - 2020 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2020, Query date: 2024-08-21 13:52:51, 931–935. https://doi.org/10.1109/WIIAT50758.2020.00142
Wu, S. (2021). Application of Artificial Intelligence in Teaching Reform of New Economics. ACM International Conference Proceeding Series, Query date: 2024-08-21 13:52:51, 572–577. https://doi.org/10.1145/3495018.3495121
Yoon, H. K. (2022). Artificial intelligence in perioperative medicine: A narrative review. Korean Journal of Anesthesiology, 75(3), 202–215. https://doi.org/10.4097/kja.22157
Zaidi, S. S. A. (2022). A multiapproach generalized framework for automated solution suggestion of support tickets. International Journal of Intelligent Systems, 37(6), 3654–3681. https://doi.org/10.1002/int.22701
Zekhnini, K. (2023). A multi-agent based big data analytics system for viable supplier selection. Journal of Intelligent Manufacturing, Query date: 2024-08-21 13:52:51. https://doi.org/10.1007/s10845-023-02253-7
Zuo, J. (2021). A Multi-agent Cluster Cooperative Confrontation Method Based on Swarm Intelligence Optimization. 2021 IEEE 2nd International Conference on Big Data, Artificial Intelligence and Internet of Things Engineering, ICBAIE 2021, Query date: 2024-08-21 13:52:51, 668–672. https://doi.org/10.1109/ICBAIE52039.2021.9390057
Authors
Copyright (c) 2024 Amril Huda M, Rani Simamora, Krim Ulwi
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.