Innovative Applications of O.R.
Improved delivery policies for future drone-based delivery systems

https://doi.org/10.1016/j.ejor.2021.02.039Get rights and content

Highlights

  • Revenue and capacity decisions for drone delivery operations under demand uncertainty.

  • Closed-form analytical solutions on when and how drone delivery should be offered.

  • Practical insights on future drone-based delivery operations for e-commerce companies.

  • Drone delivery fee and fleet size decisions through easy-to-implement policies.

Abstract

It is expected that commercial use of drones in the near future will involve delivery service operations by e-commerce companies. We consider relevant strategic and tactical decisions that these retailers will face in drone-based delivery operations, and derive policies on when to offer drone delivery, what delivery capacity to maintain, and what amount to charge for such deliveries. To this end, we develop a Markov decision process (MDP) framework, and introduce two heuristic procedures, through which near-optimal closed-form solutions can be obtained. The results are aimed at helping online retailers to determine in real time whether and to what extent to offer drone-based delivery for given product categories in different service zones. In addition, we study delivery fee structures and identify drone-based delivery pricing strategies under two widely used delivery pricing schemes. For capacity planning decisions, we describe an algorithm to identify the fleet size to utilize to fulfill uncertain demand in a given service region. We also identify structural characteristics on how these decisions and the expected profit are affected by changes in various problem parameters, which can generate generic insights on drone-based delivery operations for e-commerce companies. We find that retailers should prioritize more profitable items when allocating drone delivery capacity, and invest in adding more drones when per order opportunity costs are higher and promised delivery time thresholds are shorter. Retailers can potentially boost their net profits by increasing the effective promised delivery time threshold and/or decreasing the effective delivery delay costs and per order opportunity costs.

Introduction

Unmanned aerial vehicles (UAVs), also called drones, are expected to become a crucial part of everyday operations in many fields and industries. Several applications are already in place, such as in agricultural field analysis, crop spraying and monitoring, recreational video-taking, property and infrastructure inspections, and warehouse inventory checking (Anderson, 2017, Mazur, 2016). Such applications are expected to extend into various types of supply chain operations in the near future, specifically by playing an important role in delivery services for e-commerce companies. The Federal Aviation Administration (FAA) is in the process of developing rules and regulations for drones to fly at night and over populated areas, which should pave the way for drone-based commercial delivery services (Pasztor, 2019). As part of this process, UPS received the first authorization from the FAA to operate drones in a populated area, which is a big step towards commercial usage of drone deliveries (Black & Levin, 2019). Indications of this are also evident in moves by major online retailers and other delivery service operators. For example, Amazon has been investing significantly in its Prime Air program, which involves drone deliveries within a 30-minute time window to customers within a 15-mile radius from prospective areas where drone operations are possible. This program received approval from the FAA in 2020 (Palmer, 2020). Other leading players in this area include Google, which has been investing in a drone-delivery program named Project Wing (Kanellos, 2014), DHL through its Parcelcopter program (Bryan, 2014), Walmart (Reuters, 2020), and major e-commerce businesses Alibaba and JD.com in China which have been utilizing drones to fulfill demand in certain areas since 2016 (Harashima, 2017). Also, SF Express, the largest Chinese logistics firm, has received the first official permit to legally offer drone-based delivery services nationwide in China in March 2018 (Huang, 2018).

While specific details on drone-based delivery operations are not yet well-established, and are dependent on future government regulations, certain characteristics make this operational setting distinct when compared to traditional truck-based delivery operations. For example, drones to be used for e-commerce deliveries may deliver a small number of items per trip in a short distance, given payload weight limitations and battery capacity requirements. This is different from a regular truck-based delivery operation which involves much longer distances with a larger quantity of items. Drones can also travel at a constant high speed while trucks are vulnerable to road traffic conditions. Furthermore, drones can provide more customized delivery options, where orders can potentially be delivered to wherever the customer is located at a given time, e.g., at home, work, or on a boat. Given these types of distinctions, there exists a need for new operational approaches for the management of drone-based delivery systems to make these operations effective and efficient.

Our objective is to contribute to this emerging area by exploring several important research problems relevant to future delivery service operations using drones. More specifically, we focus on decisions involving revenue and capacity management in drone-based delivery service operations, and try to provide answers to the following research questions: Given random demand from different service zones for different product categories, when and at what rate should an online retailer accept drone-based delivery orders for each product category and service zone? Moreover, considering all relevant costs of operating a drone-based delivery operation, what are some optimal delivery fee policies? And finally, what is the optimal fleet size for a retailer, given the demand and cost structure in a service region? To answer these questions, we develop dynamic programming models to capture the specifics of the problem framework and identify policies that can help retailers make better decisions in drone-based delivery operations. We demonstrate the value of these policies through detailed numerical analyses, where we utilize representative data to improve drone delivery order acceptance policies, delivery fee structures, and system capacity decisions.

The remainder of this paper is organized as follows. In Section 2, we describe the relevant literature on drone-based deliveries and order acceptance decisions in various applications, while also highlighting the specific contributions and practical implications of our study. In Section 3, we describe the problem we investigate, and present the overall optimization model. In Section 4, we develop two practical heuristic solution approaches. In Section 5, we apply the results from the heuristics to study delivery fee structures and capacity management decisions for drone-based delivery. In Section 6, we perform numerical studies based on representative retail data and compare the performances of the two heuristics. In Section 7, we perform detailed numerical tests to investigate how the proposed policies vary with different parameter settings and to study some potential extensions, where we emphasize and provide practical implications for future drone-based operations for retailers. Finally, we summarize our findings and conclude the paper in Section 8.

Section snippets

Literature review

Our review of relevant literature involves two major areas of research. We first describe existing studies on general applications involving drone usage in delivery operations. We then summarize some relevant works on revenue and capacity decisions in settings similar to our framework, where order acceptance decisions are key considerations.

Problem description

Consider an online retailer fulfilling demand in a service region via drone-based delivery operations originating from a central warehouse. The planning horizon is a typical day that deliveries are made, and is further divided into |T| periods of duration h. We assume that the service region for the retailer is divided into a set of zones denoted by N, where the zones are based on geographical considerations and/or demand characteristics. Let si represent the average distance between zone iN

Two tractable heuristic solution procedures

We first introduce a “rejection rate” based solution procedure where we develop a formulation by considering the portion of the demand not to be fulfilled by the drone delivery system. We then provide a method to convert the rejection rate decisions back to the drone delivery offer rate decisions. As a second heuristic procedure, we relax certain assumptions in the original model and assume that the drone system is always busy fulfilling incoming orders with no idle time. We obtain closed-form

Application to delivery fee and capacity decisions

In this section we apply the results obtained in Section 4, more specifically the closed-form solutions in Section 4.2, to delivery fee and capacity decisions by retailers when utilizing drone deliveries.

Effectiveness and efficiency of the proposed heuristics

In this section we perform numerical analyses to study the performances of the two heuristic solution procedures described in Section 4. The comparative analyses suggest that the second solution procedure produces near-optimal solutions with fast computation times.

Practical insights

Utilizing the same experimental setup as described in Section 6.1, we perform sensitivity tests in this section to investigate how drone delivery offer/acceptance rates, drone fleet sizes, delivery charges, and net profits vary with respect to key model parameter values. Based on these experiments, we generate generic insights for future drone-based delivery operations. As noted above, the second solution procedure produces near-optimal performances with a fast real-time computing ability, and

Conclusions

In this paper we study capacity and revenue management decisions by online retailers on future drone-based delivery systems, specifically as they relate to drone delivery offer/acceptance rates, delivery fee structures, and fleet size decisions. We develop a stochastic dynamic programming model, and propose two heuristics to obtain analytical and numerical insights on such decisions. More specifically, we derive solutions that could help a retailer on whether and to what extent to offer

References (75)

  • K. Altendorfer et al.

    Influence of order acceptance policies on optimal capacity investment with stochastic customer required lead times

    European Journal of Operational Research

    (2014)
  • Amazon (2018). Amazon Prime Air. Retrieved May 10, 2018...
  • Amazon (2019). Prime members can get a little extra something with free no-rush shipping! Retrieved May 20, 2019...
  • C. Anderson

    The drone economy

    Harvard Business Review

    (2017)
  • G. Baloch et al.

    Strategic network design for parcel delivery with drones under competition

    Transportation Science

    (2020)
  • R. Batta

    Single server queueing-location models with rejection

    Transportation Science

    (1988)
  • T. Black et al.

    UPS Drones win FAA milestone permission to take off shackles

    Bloomberg

    (2019)
  • N. Boysen et al.

    Drone delivery from trucks: Drone scheduling for given truck routes

    Networks

    (2018)
  • V.V. Bryan

    Drone delivery: DHL ‘parcelcopter’ flies to German isle

    Reuters

    (2014)
  • V. Bulusu et al.

    Unmanned aviation: To be free or not to be free?

    Proceedings of 7th international conference on research in air transportation

    (2016)
  • J.F. Campbell et al.

    Strategic design for delivery with trucks and drones

    Supply Chain Analytics Report SCMA

    (2017)
  • M. Chen et al.

    Optimal routing algorithm in swarm robotic systems

    California Institute of Technology

    (2014)
  • W.C. Chiang et al.

    An overview of research on revenue management: current issues and future research

    International Journal of Revenue Management

    (2006)
  • Y. Choi et al.

    Optimization of multi-package drone deliveries considering battery capacity

    Proceedings of the 96th annual meeting of the transportation research board, Washington, DC, USA

    (2017)
  • S.H. Chung et al.

    Optimization for drone and drone-truck combined operations: A review of the state of the art and future directions

    Computers & Operations Research

    (2020)
  • G. Cosmetatos

    Notes: Approximate explicit formulae for the average queueing time in the processes (M/D/r) and (D/M/r)

    INFOR: Information Systems and Operational Research

    (1975)
  • J. Dai et al.

    Inpatient overflow: An approximate dynamic programming approach

    Manufacturing & Service Operations Management

    (2019)
  • F. Defregger et al.

    Revenue management for a make-to-order company with limited inventory capacity

    OR Spectrum

    (2007)
  • Dermpro, R. (2020). When do aesthetics purchasers buy online? Retrieved June 04, 2020...
  • DHL (2014). A DHL perspective on implications and use cases for the logistics industry. Retrieved June 04, 2020...
  • K. Dorling et al.

    Vehicle routing problems for drone delivery

    IEEE Transactions on Systems, Man, and Cybernetics: Systems

    (2017)
  • E. Frachtenberg

    Practical drone delivery

    Computer

    (2019)
  • Y. Gong et al.

    A polling-based dynamic order picking system for online retailers

    IIE Transactions

    (2008)
  • P. Grippa et al.

    Drone delivery systems: job assignment and dimensioning

    Autonomous Robots

    (2019)
  • D. Harashima

    China’s swamped logistics sector turns to machines for help

    Nikkei Asian Review

    (2017)
  • M. Hassanalian et al.

    Classifications, applications, and design challenges of drones: A review

    Progress in Aerospace Sciences

    (2017)
  • G.M. Hoffmann et al.

    Decentralized cooperative collision avoidance for acceleration constrained vehicles

    Proceedings of the 47th IEEE conference on decision and control

    (2008)
  • Cited by (26)

    • Modeling optimal drone fleet size considering stochastic demand

      2024, EURO Journal on Transportation and Logistics
    • Planning delivery-by-drone micro-fulfilment centres

      2024, Transportmetrica A: Transport Science
    • When drone delivery meets human courier: A co-sourcing perspective

      2023, Transportation Research Part C: Emerging Technologies
    View all citing articles on Scopus
    View full text