2024年 04期

Online Learning Resource Recommendation by Using Parallel Spectral Clustering Algorithm Based on Spark Platform


摘要(Abstract):

为了提高在线学习资源推荐的准确度,采用谱聚类用于学习资源的归类,将类别相似度高的资源推荐给用户,提出Spark平台的并行化谱聚类算法,提高资源推荐效率;首先提取在线学习资源及用户特征并初始化,建立谱聚类模型,在Spark平台上分别求解无向图的顶点相似度及归一化拉普拉斯系数;然后采用归一化分割划分子集,通过归一化割集优化方式求解类别特征,并对类别特征按行输出特征点;最后采用k均值算法对特征点进行聚类,获得聚类结果。结果表明,采用谱聚类算法并借助于Spark平台的计算优势,所提推荐方法比常用的在线学习资源推荐算法的准确率和覆盖率更高,在海量学习资源的实时推荐方面具有较高适应度。

关键词(KeyWords): 在线学习;资源推荐;谱聚类;Spark平台;图分割

基金项目(Foundation): 国家自然科学基金项目(62176142);; 国家社会科学基金项目(BJA190094)

作者(Author): 刘莹,杨淑萍,张治国

DOI: 10.13349/j.cnki.jdxbn.20240530.001

参考文献(References):

[1] KARAOGLAN YILMAZ F G,YILMAZ R.Learning analytics intervention improves students’ engagement in online learning[J].Technology,Knowledge and Learning,2022,27(2):449.

[2] 孔晓晓.基于知识图谱自动构建的可用资源表示与推荐[J].济南大学学报(自然科学版),2023,37(2):235.

[3] 程岩.在线学习中基于群体智能的学习路径推荐方法[J].系统管理学报,2011,20(2):232.

[4] 歹杰,李青山,褚华,等.突破智慧教育:基于图学习的课程推荐系统[J].软件学报,2022,33(10):3656.

[5] BERAHMAND K,MOHAMMADI M,FAROUGHI A,et al.A novel method of spectral clustering in attributed networks by constructing parameter-free affinity matrix[J].Cluster Computing,2022,12:1.

[6] El HAJJAR S,DORNAIKA F,ABDALLAH F.Multi-view spectral clustering via constrained nonnegative embedding[J].Information Fusion,2022,78:209.

[7] AYTEKIN C,OZAN E C,KIRANYAZ S,et al.Extended quantum cuts for unsupervised salient object extraction[J].Multimedia Tools & Applications,2017,76(8):10443.

[8] WANG Y R,DING S F,WANG L J,et al.A manifold p-spectral clustering with sparrow search algorithm[J].Soft Computing,2022,26(4):1765.

[9] HUANG S H,WENG H L,FENG Y.Spectral clustering via adaptive layer aggregation for multi-layer networks[J].Journal of Computational and Graphical Statistics,2023,32(3):1170.

[10] TIAN Y H,ZHENG B,WANG Y F,et al.College library personalized recommendation system based on hybrid recommendation algorithm[J].Procedia CIRP,2019,83:490.

[11] LIN J Q,XIAO A H,DONG S B,et al.Spark-ITGO:a parallel invasive tumor growth optimization algorithm on spark[J].Cluster Computing,2022,25(4):2633.

[12] JIANG K,DU S F,ZHAO F,et al.Effective data management strategy and RDD weight cache replacement strategy in Spark[J].Computer Communications,2022,194:66.

[13] DO P,PHAN T H V.Developing a BERT based triple classification model using knowledge graph embedding for question answering system[J].Applied Intelligence,2022,52(1):636.

[14] 覃忠台,张明军.基于协同过滤算法的学习资源推荐模型研究[J].计算机技术与发展,2021,31(9):31.

[15] 卢春华,杨辉,李云鹏.一种基于本体和循环神经网络的在线学习资源推荐技术[J].情报理论与实践,2019,42(12):150.

[16] 宋菲菲,隋栋,周湘贞.基于深度学习的智能学习资源推荐算法[J].南京理工大学学报(自然科学版),2022,46(2):185.