Systems Engineering and Electronics ›› 2024, Vol. 46 ›› Issue (3): 963-971.doi: 10.12305/j.issn.1001-506X.2024.03.22
• Systems Engineering • Previous Articles Next Articles
Runnan QIN1,*, Xiaodong PENG1, Wenming XIE1, Jianjiang HUI2, Weichun FENG2, Jiahong JIANG2
Received:
2023-01-12
Online:
2024-02-29
Published:
2024-03-08
Contact:
Runnan QIN
CLC Number:
Runnan QIN, Xiaodong PENG, Wenming XIE, Jianjiang HUI, Weichun FENG, Jiahong JIANG. Design of publish/subscribe system for big-data security transmission of spacecraft[J]. Systems Engineering and Electronics, 2024, 46(3): 963-971.
Table 1
Different publish/subscribe system response delay comparison"
名称 | 数据订阅响应时延 | |||||||||||||||||||
测控遥测数据包(json)数量 | 数传遥测数据包(txt)数量 | 数传图像数据包(jpeg)数量 | 遥控指令数据包(xml)数量 | 平均 | ||||||||||||||||
10 | 100 | 1 000 | 10 000 | 10 | 100 | 1 000 | 10 000 | 10 | 100 | 1 000 | 10 000 | 10 | 100 | 1 000 | 10 000 | |||||
Kafka | 0.09 | 0.92 | 5.96 | 59.89 | 0.15 | 0.58 | 6.14 | 52.69 | 0.26 | 2.50 | 22.14 | 239.7 | 0.08 | 0.53 | 5.52 | 61.08 | 28.64 | |||
ActiveMQ | 0.01 | 0.02 | 0.05 | 0.08 | 0.01 | 0.02 | 0.06 | 0.09 | 0.08 | 0.08 | 0.09 | 0.11 | 0.02 | 0.08 | 0.12 | 0.12 | 0.07 | |||
RabbitMQ | 0.02 | 0.17 | 0.17 | 0.19 | 0.03 | 0.16 | 0.20 | 0.20 | 0.02 | 0.19 | 0.20 | 0.21 | 0.03 | 0.16 | 0.16 | 0.17 | 0.14 | |||
RocketMQ | 0.04 | 0.04 | 0.03 | 0.08 | 0.04 | 0.08 | 0.11 | 0.13 | 0.08 | 0.10 | 0.18 | 0.27 | 0.02 | 0.12 | 0.22 | 0.29 | 0.11 | |||
BPSS* | 0.01 | 0.02 | 0.05 | 0.06 | 0.01 | 0.02 | 0.04 | 0.05 | 0.03 | 0.06 | 0.08 | 0.10 | 0.02 | 0.05 | 0.07 | 0.09 | 0.05 |
Table 5
Data transmission performance comparison of different publish/subscribe systems %"
名称 | 参数 | 传输1 h | 传输6 h | 传输12 h | 传输24 h |
Kafka | 丢帧率 | 0.102 | 0.245 | 0.435 | 0.812 |
破损率 | 0.045 | 0.093 | 0.082 | 0.062 | |
ActiveMQ | 丢帧率 | 0.012 | 0.067 | 0.092 | 0.103 |
破损率 | 0.024 | 0.038 | 0.042 | 0.032 | |
RabbitMQ | 丢帧率 | 0.033 | 0.049 | 0.072 | 0.065 |
破损率 | 0.018 | 0.035 | 0.052 | 0.044 | |
RocketMQ | 丢帧率 | 0.028 | 0.039 | 0.065 | 0.047 |
破损率 | 0.020 | 0.032 | 0.039 | 0.029 | |
BPSS* | 丢帧率 | 0.026 | 0.030 | 0.024 | 0.025 |
破损率 | 0.027 | 0.022 | 0.019 | 0.018 |
1 | 王会斌, 呼延奇, 郑悦, 等. 航天器空间辐射效应分析技术现状与思考[J]. 航天器环境工程, 2022, 39 (4): 427- 435. |
WANG H B , HU Y Q , ZHENG Y , et al. Current situation and thinking of spacecraft space radiation effect analysis technology[J]. Spacecraft Environmental Engineering, 2022, 39 (4): 427- 435. | |
2 | 李文龙, 孔祥龙, 马伟, 等. 高轨卫星平台在轨顽存技术体系[J]. 系统工程与电子技术, 2021, 43 (3): 731- 739. |
LI W L , KONG X L , MA W , et al. Technology system of on-orbit strong survivability for GEO satellite bus[J]. Systems Engineering and Electronics, 2021, 43 (3): 731- 739. | |
3 | SUN B, ZHANG L, CHEN Y H. Design of big data processing system for spacecraft testing experiment[C]//Proc. of the IEEE International Symposium on Microwave, Antenna, Propagation, and EMC Technologies, 2017: 164-167. |
4 | 何友, 朱扬勇, 赵鹏, 等. 国防大数据概论[J]. 系统工程与电子技术, 2016, 38 (6): 1301- 1305. |
HE Y , ZHU Y Y , ZHAO P , et al. Panorama of national defense big data[J]. Systems Engineering and Electronics, 2016, 38 (6): 1301- 1305. | |
5 | GALLAGHER P J . Cloud computing[J]. Iron & Steel Technology, 2022, 19 (2): 32- 34. |
6 |
GIRI P R , SHARMA G . Apache hadoop architecture, applications, and hadoop distributed file system[J]. Semiconductor Science and Information Devices, 2022, 4 (1): 14- 20.
doi: 10.30564/ssid.v4i1.4619 |
7 |
ZHANG C Y , CHEN W Y , CHEN Q , et al. Distributed intelligent reflecting surfaces-aided device-to-device communications system[J]. Journal of Communication and Information Network, 2021, 6 (3): 197- 207.
doi: 10.23919/JCIN.2021.9549117 |
8 | TSENOS M, KALOGERAKI V. Dynamic rate control for topic-based Pub/Sub systems[C]//Proc. of the IEEE International Conference on Mobile Data Management, 2021: 272-273. |
9 | PEDDIREDDY K. Streamlining enterprise data processing, reporting and realtime alerting using apache kafka[C]//Proc. of the International Symposium on Digital Forensics and Security, 2023. |
10 | XIAN J H, YANG H S, KIM Y H. Performance analysis of Restful API and RabbitMQ for microservice web application[C]//Proc. of the International Conference on Information and Communication Technology Convergence, 2018: 257-259. |
11 | MA Y, YAN R Y, SUN J W, et al. A MQTT protocol message push server based on RocketMQ[C]//Proc. of the International Conference on Intelligent Computation Technology and Automation, 2017: 295-298. |
12 | CHEN Y . Design and implementation of universal data transmission framework based on activeMQ[J]. Modern Information Technology, 2019, 3 (10): 26- 28. |
13 | DING T C, QIAN S Y, ZHU W D, et al. Comat: an effective composite matching framework for content-based Pub/Sub systems[C]//Proc. of the International Conference on Parallel & Distributed Processing with Applications, 2021: 236-243. |
14 | YANG T , ZHOU X S , LIN Y . A publish-subscribe system based on CORBA[J]. Computer Engineering, 2004, 30 (10): 77- 78. |
15 | DAYAL J, BRATCHER D, EISENHAUER G, et al. Flexpath: type-based publish/subscribe system for large-scale science analytics[C]//Proc. of the International Symposium on Cluster, Cloud and Grid Computing, 2014. |
16 | FENG Q L, SHI R S, LUO Q F, et al. Scalable blind match-ing: an efficient ciphertext matching scheme for content-based Pub/Sub cloud services[C]//Proc. of the International Confe-rence on Big Data, 2020: 5668-5670. |
17 | PEDRO F M, RAFAEL F R, JOBERTO S B. A publish/subscribe QoS-aware framework for massive IoT traffic orchestra-tion[EB/OL]. [2022-12-20]. arxiv.org/pdf/1806.03157v1.pdf. |
18 | SHILPASHREE K S , HARSHAVARDHAN L . Incorporating Google cloud based Pub/Sub in implementation of identity concentrated encryption[J]. International Journal of Science and Research, 2015, 4 (5): 2927- 2930. |
19 | ULLAH M H, PARK S S, NO J, et al. A collaboration mecha-nism between wireless sensor network and cloud through a Pub/Sub based middleware service[C]//Proc. of the 5th International Conference on Evolving Internet, 2013: 38-42. |
20 | LAMPORT L , SHOSTAK R , PEASE M . The part-time parliament[M]. Concurrency: The Works of Leslie Lamport, 2019: 203- 226. |
21 | ONGARO D, OUSTERHOUT J. In search of an understandable consensus algorithm[EB/OL]. [2022-12-13]. http://ramcloud.stanford.edu/Raft.pdf. |
22 | NISCHWITZ M, ESCHE M, TSCHORSCH F. Bernoulli meets PBFT: modeling BFT protocols in the presence of dynamic failures[C]//Proc. of the 16th Conference on Computer Science and Intelligence Systems, 2021: 291-300. |
23 | HAYAMI A. Heartbeat detection device, heartbeat detection methond, and program[P]. U.S. A: US20210244287A1, 2021. |
24 | 张润东, 李永洲, 任续津, 等. 基于任务监听的加固机多机系统及冗余设计方法[P]. 中国: CN114355803A, 2022. |
ZHANG R D, LI Y Z, REN X J, et al. Multi machine system and redundancy design method of reinforcement machine based on task monitoring[P]. China: CN114355803A, 2022. | |
25 | 代长波. 分布式系统自适应故障检测技术研究[D]. 杭州: 浙江大学, 2017. |
DAI C B. Research on adaptive fault detection technology for distributed systems[D]. Hangzhou: Zhejiang University, 2017. | |
26 | POUR F , TATAR U , GHEORGHE A V . Blockchain empo-wered disaster recovery framework[J]. International Journal of System of Systems Engineering, 2022, 12 (1): 51- 62. |
27 | LIANG S, ZENG J W, JIN L, et al. Computer design and test of suspension control based on two-machine hot standby for speed maglev train[C]//Proc. of the 39th Chinese Control Conference, 2020: 4147-4152. |
28 | FENG X Q , MA J F , LIU S B , et al. Auto-scalable and fault-tolerant load balancing mechanism for cloud computing based on the proof-of-work election[J]. Science China Information Sciences, 2021, 65 (1): 127- 142. |
29 | IYER S, MUTHURAMAN S G, SUBRAMANI S, et al. System and method for leader election for distributed systems[P]. U.S. A: US11159611B2, 2021. |
30 | MADISETTI V K , PANDA S . A dynamic leader election algorithm for decentralized networks[J]. Journal of Transportation Technologies, 2021, 11 (3): 404- 411. |
[1] | Tao LIU, Shasha WANG, Chi ZHANG, Guanghan BAI, Junyong TAO. Resilience based self-organizing region coverage method for unmanned aerial vehicle swarm [J]. Systems Engineering and Electronics, 2024, 46(3): 942-952. |
[2] | Wenkang HAO, Qifeng CHEN. Distributed model predictive energy-saving control of UAVs formation with fuzzy constraints [J]. Systems Engineering and Electronics, 2024, 46(3): 1021-1030. |
[3] | Yuang ZHU, Yali ZHAO, Jialuan HE, Chenguang ZHANG, Chaojun WU, Xiaoxiao JIA. Topology discovery method for mobile communication systems based on distributed SDN [J]. Systems Engineering and Electronics, 2024, 46(1): 357-365. |
[4] | Zengmao CHEN, Kailin WANG, Zhiguo SUN, Rongchen SUN, Sileng AER. Eigenvalue difference spectrum sensing algorithm under Alpha stable distributed noise [J]. Systems Engineering and Electronics, 2023, 45(9): 2949-2955. |
[5] | Wenbo LIU, Yirong YAO, Gong ZHANG, Wen HU. Concept, application, and research progress of hyperdimensional computing [J]. Systems Engineering and Electronics, 2023, 45(7): 1938-1956. |
[6] | Yuhang HAO, Wei JIANG, Zengfu WANG, Hua LAN, Ting YONG, Quan PAN. Distributed MIMO sky-wave over-the-horizon-radar simulation system [J]. Systems Engineering and Electronics, 2023, 45(7): 1981-1989. |
[7] | Hanyu QIAN, Xiaoman TIAN, Bing XIAO, Lu CAO, Rui WANG, Xiwei WU. Balanced task allocation method for distributed satellite swarm game [J]. Systems Engineering and Electronics, 2023, 45(6): 1797-1804. |
[8] | Tianye SUN, Wei SUN, Jianjun WU. UAV formation rapid assembly method based on improved Quatre algorithm [J]. Systems Engineering and Electronics, 2022, 44(9): 2840-2848. |
[9] | Taiyang HU, Jinyu ZHANG, Hailiang LU, Pengfei LI, Yinan LI, Rongchuan LYU. Distributed synthetic aperture microwave radiometric high-resolution imaging algorithm based on data fusion [J]. Systems Engineering and Electronics, 2022, 44(8): 2403-2409. |
[10] | Lin SUN, Zhongyang MAO, Jiafang KANG, Lei ZHANG. Energy efficiency maximization-based spectrum allocation algorithm for maritime relay communication system [J]. Systems Engineering and Electronics, 2022, 44(8): 2661-2667. |
[11] | Pengfei LI, Hailiang LU, Tao HAN, Pengju DANG, Yinan LI, Hao LI, Rongchuan LYU. Distributed microwave radiometer based on leaky wave antenna [J]. Systems Engineering and Electronics, 2022, 44(7): 2125-2133. |
[12] | Hongliang LIU, Chao CHEN, Kunwei HUANG, Bo LU, Kai YUE. Multi-frame joint track initiation method for distributed radar network [J]. Systems Engineering and Electronics, 2022, 44(7): 2143-2147. |
[13] | Xiang LIU, Tianyao HUANG, Yimin LIU. Distributed target detection for frequency agile radars [J]. Systems Engineering and Electronics, 2022, 44(6): 1833-1838. |
[14] | Shouzhen ZENG, Yingjie HU. Group decision making method for distributed linguistic trust network based on highly incomplete information [J]. Systems Engineering and Electronics, 2022, 44(6): 1907-1919. |
[15] | Tianyang GAO, Xiaoxuan HU, Wei XIA. Constellation autonomous mission planning algorithm based on distributed co-evolution [J]. Systems Engineering and Electronics, 2022, 44(5): 1600-1608. |
Viewed | ||||||
Full text |
|
|||||
Abstract |
|
|||||