Cargando…

Application of Deep Reinforcement Learning Algorithm in Uncertain Logistics Transportation Scheduling

Nowadays, finding the optimal route for vehicles through online vehicle path planning is one of the main problems that the logistics industry needs to solve. Due to the uncertainty of the transportation system, especially the last-mile delivery problem of small packages in uncertain logistics transp...

Descripción completa

Detalles Bibliográficos
Autores principales: Yuan, Yunmei, Li, Hongyu, Ji, Lili
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8487393/
https://www.ncbi.nlm.nih.gov/pubmed/34608384
http://dx.doi.org/10.1155/2021/5672227
_version_ 1784577947448901632
author Yuan, Yunmei
Li, Hongyu
Ji, Lili
author_facet Yuan, Yunmei
Li, Hongyu
Ji, Lili
author_sort Yuan, Yunmei
collection PubMed
description Nowadays, finding the optimal route for vehicles through online vehicle path planning is one of the main problems that the logistics industry needs to solve. Due to the uncertainty of the transportation system, especially the last-mile delivery problem of small packages in uncertain logistics transportation, the calculation of logistics vehicle routing planning becomes more complex than before. Most of the existing solutions are less applied to new technologies such as machine learning, and most of them use a heuristic algorithm. This kind of solution not only needs to set a lot of constraints but also requires much calculation time in the logistics network with high demand density. To design the uncertain logistics transportation path with minimum time, this paper proposes a new optimization strategy based on deep reinforcement learning that converts the uncertain online logistics routing problems into vehicle path planning problems and designs an embedded pointer network for obtaining the optimal solution. Considering the long time to solve the neural network, it is unrealistic to train parameters through supervised data. This article uses an unsupervised method to train the parameters. Because the process of parameter training is offline, this strategy can avoid the high delay. Through the simulation part, it is not difficult to see that the strategy proposed in this paper will effectively solve the uncertain logistics scheduling problem under the limited computing time, and it is significantly better than other strategies. Compared with traditional mathematical procedures, the algorithm proposed in this paper can reduce the driving distance by 60.71%. In addition, this paper also studies the impact of some key parameters on the effect of the program.
format Online
Article
Text
id pubmed-8487393
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-84873932021-10-03 Application of Deep Reinforcement Learning Algorithm in Uncertain Logistics Transportation Scheduling Yuan, Yunmei Li, Hongyu Ji, Lili Comput Intell Neurosci Research Article Nowadays, finding the optimal route for vehicles through online vehicle path planning is one of the main problems that the logistics industry needs to solve. Due to the uncertainty of the transportation system, especially the last-mile delivery problem of small packages in uncertain logistics transportation, the calculation of logistics vehicle routing planning becomes more complex than before. Most of the existing solutions are less applied to new technologies such as machine learning, and most of them use a heuristic algorithm. This kind of solution not only needs to set a lot of constraints but also requires much calculation time in the logistics network with high demand density. To design the uncertain logistics transportation path with minimum time, this paper proposes a new optimization strategy based on deep reinforcement learning that converts the uncertain online logistics routing problems into vehicle path planning problems and designs an embedded pointer network for obtaining the optimal solution. Considering the long time to solve the neural network, it is unrealistic to train parameters through supervised data. This article uses an unsupervised method to train the parameters. Because the process of parameter training is offline, this strategy can avoid the high delay. Through the simulation part, it is not difficult to see that the strategy proposed in this paper will effectively solve the uncertain logistics scheduling problem under the limited computing time, and it is significantly better than other strategies. Compared with traditional mathematical procedures, the algorithm proposed in this paper can reduce the driving distance by 60.71%. In addition, this paper also studies the impact of some key parameters on the effect of the program. Hindawi 2021-09-25 /pmc/articles/PMC8487393/ /pubmed/34608384 http://dx.doi.org/10.1155/2021/5672227 Text en Copyright © 2021 Yunmei Yuan et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Yuan, Yunmei
Li, Hongyu
Ji, Lili
Application of Deep Reinforcement Learning Algorithm in Uncertain Logistics Transportation Scheduling
title Application of Deep Reinforcement Learning Algorithm in Uncertain Logistics Transportation Scheduling
title_full Application of Deep Reinforcement Learning Algorithm in Uncertain Logistics Transportation Scheduling
title_fullStr Application of Deep Reinforcement Learning Algorithm in Uncertain Logistics Transportation Scheduling
title_full_unstemmed Application of Deep Reinforcement Learning Algorithm in Uncertain Logistics Transportation Scheduling
title_short Application of Deep Reinforcement Learning Algorithm in Uncertain Logistics Transportation Scheduling
title_sort application of deep reinforcement learning algorithm in uncertain logistics transportation scheduling
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8487393/
https://www.ncbi.nlm.nih.gov/pubmed/34608384
http://dx.doi.org/10.1155/2021/5672227
work_keys_str_mv AT yuanyunmei applicationofdeepreinforcementlearningalgorithminuncertainlogisticstransportationscheduling
AT lihongyu applicationofdeepreinforcementlearningalgorithminuncertainlogisticstransportationscheduling
AT jilili applicationofdeepreinforcementlearningalgorithminuncertainlogisticstransportationscheduling