Professional Documents
Culture Documents
6 | SEPTEMBER 2019
REGULATIONS
& UXVS
MARITIME
ROBOTICS
28
ON THE COVER
REGULATORY
SMORGASBORD
32
MANAGING
AUTONOMY
36
ONE INDUSTRY.
ONE VOICE.
Every day, members of Congress work on legislation that can either boost or hinder
the advancement and deployment of unmanned and autonomous systems. The
annual AUVSI Hill Day is an opportunity for the entire industry to come together
and declare, with one unified voice, how unmanned technology is making a positive
impact on local communities and economies across the country.
Join us at Hill Day and take advantage of the opportunity to educate your
lawmakers and advocate for your business.
REGULATION IS NECESSARY
TO ADVANCE UNMANNED SYSTEMS
In a recent analysis, just 10 percent concerns, thereby facilitating the
of the unmanned aircraft systems integration of AVs on our roads and
included in AUVSI’s Unmanned highways.
Systems and Robotics Database are Furthermore, changes to existing
equipped with navigation systems and rules are sometimes needed to enable
communication links, which extend technological advancements. At the
over long distances, that enable UAS Automated Vehicles Symposium
to fly beyond line of sight (BLOS). While that AUVSI hosted with the
the BLOS technology has existed for Transportation Research Board in July,
years, only the military is currently federal officials affirmed they are
permitted to use it. The absence of committed to protecting the freedom
federal regulation allowing commercial of all Americans to make mobility
BLOS operations hinders the full value choices that best serve them. The
and benefits that UAS has to offer. U.S. Department of Transportation
As you will read in the regulatory is following through on that policy
update article later in this issue, by offering a proposal to remove
regulations that provide guidance Brian Wynne some current regulatory barriers to
and rules for operating unmanned President And CEO, encourage the development of AV
systems are necessary for the AUVSI technology.
industry’s advancement. For instance, Regulations are also necessary for
earlier this year the Federal Aviation unmanned maritime systems (UMS),
Administration issued a proposed which must meet the International
rule for UAS operations over people, Regulations for Preventing Collisions
and the UAS community is eagerly at Sea (COLREGs). Conversely, the
anticipating the agency to offer an Coast Guard is relying on industry’s
additional rule requiring UAS to be expertise to determine what
equipped with Remote Identification. regulations apply or need updating
Remote ID is a crucial next step to A streamlined to allow for the safe and efficient
gain the confidence of federal defense regulatory integration of UMS into the nation’s
and security agencies, manned navigable waterways. While COLREGs
aviation users and the public to further
environment remain a major piece of the puzzle,
integrate UAS into the airspace. is integral to the Coast Guard wants stakeholder
By identifying themselves through input on the infrastructure, manning,
remote ID, UAS operators would likely
allow for the and autonomy policies that require
gain authority to fly over people and safe integration modification before maritime systems
eventually perform BLOS operations of unmanned can undertake basic unmanned
such as inspection of utility rights of operations.
way, widespread search and rescue systems into Innovation and imagination
missions, and package delivery. our nation’s continue to introduce a wide array of
A clear, national regulatory applications for unmanned systems.
framework and the support of the transportation However, regulatory barriers can limit
federal government is also required to network. ... this progress. A streamlined regulatory
drive the deployment of driverless cars environment is integral to allow for the
and trucks. A recent survey of industry safe integration of unmanned systems
professionals and government into our nation’s transportation
policymakers involved with automated network and to promote their
vehicles (AVs) conducted by AUVSI and acceptance and adoption by
Perkins Coie found that regulations businesses and consumers for even
enhance safety and dispel consumer more transformative uses.
Webinars are FREE for AUVSI members and $49 for non-members.
Learn more about becoming an AUVSI member at auvsi.org/why-join-auvsi
MARITIME
28 ROBOTICS
Key to maintaining U.S. advantage
in undersea realm
18 TOP UPDATE
TOP program draws increased enterprise
interest, takes top ASAE award
REGULATORY
36
SMORGASBORD
FAA developing a menu of new rules to oversee
booming unmanned aviation sector
32 MANAGING
AUTONOMY
Regulators seek to promote the AV
industry, boost safety, protect spectrum
DEPARTMENTS
8 Industry Trends
• BAE tests autonomous boat
12 Company Highlight
Organic growth, good tech helps
26 Viewfinder
Seattle, Washington
• Optimus Ride launches in NY SkySkopes vault to top tier of DSPs
10 Essential Components
• Shuttle tested at Texas airport
22 Technology Gap
Robotic Skies makes sure growing
40 Chapter News
Updates from Saguaro, Hampton
• Team tests robotic charging station drone fleets can stay in the air Roads, Ridge and Valley, Great
Plains and San Diego Lindbergh
TECHNOLOGY
UPDATE
On the road or in the air, unmanned
systems show value with package
deliveries
24
14 Q&A
Exclusive Q&A with Lt. Gen Todd Semonite,
head of the U.S. Army Corps of Engineers
42 Far Out
MIT researchers help driverless cars,
robots spot objects amid clutter
45 Social Update
Top stories on AUVSI’s social media
pages
2700 S. Quincy St. | Suite 400 | Arlington, VA 22206 USA
P: +1 703 845 9671 F: +1 703 845 9679
Email: info@auvsi.org
www.auvsi.org
2018 – 2021
Meetings and Conventions
Staci Butler, Vice President, Meetings and Conventions, sbutler@auvsi.org
Ben Gielow, Amazon
Karissa Bingham, Senior Meetings Manager, kbingham@auvsi.org
Marke Gibson
Lindsay Voss, Director, Education, lvoss@auvsi.org
Robert Hess, Unmanned Perspective LLC
Jason Blachek, Registration and Housing Manager, jblachek@auvsi.org
Houston Mills, UPS
Nicole Mattar Meetings Specialist, nmattar@auvsi.org
Susan Roberts, Panasonic Aviation Corp.
Contents of the articles are the sole opinions of the authors and do not necessarily express the
Marketing & Partnerships
policies or opinion of the publisher, editor, AUVSI, or any entity of the U.S. government. Materials may Stephanie Robert, Director, Marketing, srobert@auvsi.org
not be reproduced without written permission. Authors are responsible for assuring that the articles
are properly released for classification and proprietary information. All advertising will be subject to
Saloni Patni, Marketing Specialist, spatni@auvsi.org
publisher’s approval and advertisers will agree to indemnify and relieve publisher of loss or claims Daniel Benavides, Creative Strategist, dbenavides@auvsi.org
resulting from advertising contents. Annual subscription requests may be addressed to AUVSI.
Unmanned Systems is provided with AUVSI membership. Sabine Hannoush, Graphic Designer, shannoush@auvsi.org
RoboNation Staff
Daryl Davidson, Executive Director, davidson@robonation.org
Norma Floriza, Director of Operations, floriza@robonation.org
Janelle Curtis, Programs & Development Director, curtis@robonation.org
Hitesh Patel, Robotic Programs Director, patel@robonation.org
Lindsey Groark, STEM Programs Director, lgorark@robonation.org
Cheri Koch, Events Senior Manager, koch@robonation.org
Contributing Authors Julianna Smith, Communications & Outreach Coordinator, smith@robonation.org
Lydia Bae, Office Manager, bae@robonation.org
Marc Selinger is a freelance writer based in the Washington, D.C.,
area. He can be reached at marc2255@yahoo.com. David Young, Product & Training Coordinator, dyoung@robonation.org
Yi Walls, Staff Accountant, ywalls@robonation.org
Cheryl Hedeen, Community Engagement & Training Coordinator, chdeen@robonation.org
Laverne Imori, Customer Service Coordinator, limori@robonation.org
6 | UNMANNED SYSTEMS | SEPTEMBER 2019
FEATURED
EVENT
AUVSI HILL
DAY & SCIENCE
AND TECH FAIR
2019
ASSOCIATION
EVENTS September
25, 2019
Rayburn House
Office Building
Banquet Rooms
2044 and 2045
Washington, D.C.
Global Security Exchange 2019 World Safety Summit
(GSX) on Autonomous Technology
Sept McCormick Place Levi’s Stadium
Oct
8 - 12 Chicago Santa Clara, California
2
VW’s Electrify America has teamed with Stable Auto to deploy robotic charging platforms for AVs at a demo site in San Francisco.
Image: Electrify America
Electrify America, Stable Auto The platform will seek to charge autonomous EVs without
human intervention using a robotic platform attached to
team to deploy robotic charging a 150-kilowatt DC fast charger. Expected to open in early
platforms for AVs 2020, the charging location will be Stable’s first commercial
autonomous charging site.
Electrify America, a wholly owned subsidiary of Volkswagen “Autonomous vehicles will play an important role in
Group of America, has announced it will work with Stable the future of driving, particularly with fleets, and tailored
Auto, a San Francisco-based electric vehicle fleet charging charging options for self-driving EVs will be critical to
company, to deploy robotic charging platforms for self- develop that effort,” says Wayne Killen, Electrify’s director of
driving vehicles in a pilot demonstration site in San Francisco. infrastructure planning and business development.
DJI introduces first-person viewing FPV Air Unit Transmission Module, an FPV remote controller
and an FPV camera.
transmission system for drone According to DJI, this technology is the “next evolutionary
racing step” forward in drone racing technology, as it opens a world
of creative possibilities for pilots by offering “smooth, clear
DJI has introduced its DJI Digital First Person Viewing HD video, ultra-low end-to-end latency and long-range
(FPV) Transmission System, which it describes as an transmission with strong anti-interference technology
“advanced digital ecosystem” that includes FPV goggles, an packaged into a simplified setup.”
Sea Machine Robotics, to showcase how Sea Machines’ Marine Industries — with its SM300
autonomous technology can be used autonomous-command system. Sea
Marad showcase to increase the safety, response time Machines will train MSRC personnel on
oil-spill response tech and productivity of marine oil-spill
response operations.
how to operate the system.
Sea Machines and MSRC performed
Sea Machines Robotics and the On-water exercises will be simulated oil-spill recovery exercises
U.S. Department of Transportation’s conducted once Sea Machines in the harbor of Portland, Maine on
Maritime Administration (MARAD) have equips a Marine Spill Response Corp. Aug. 21, before an audience made up
entered into a cooperative agreement (MSRC)-owned MARCO skimming of government, naval, international,
vessel — manufactured by Kvichak environmental and industry partners.
SenseFly combining eBee X UAS S.O.D.A. 3D, senseFly Aeria X or MicaSense RedEdge-MX
sensor will not only get the UAS for $1,000 off, but will also
with Agisoft software receive a six-month Agisoft Metashape Professional license.
SenseFly says the eBee X equipped with the intelligent
SenseFly has announced a limited-time offer that photogrammetry software will provide users with a “fully
combines the company’s senseFly eBee X UAS and its suite integrated and highly precise suite of cameras as well as
of cameras with the intelligent photogrammetry software powerful software that enables the generation of high-
from Agisoft Metashape. quality point clouds, orthomosaics and digital elevation
During the time of the offer, which lasts until Sept. 30, models — all while reducing operation time and costs for end
2019, customers who purchase an eBee X with the senseFly users.”
Dakota to obtain a Section 333 exemption which that we wanted to be very conservative in our financial
allowed them to fly commercially, “but nobody really approach to the business. And, through that, I think
knew at the time how to use these SUAS industrially we’ve really proven we’re an extremely effective,
in North Dakota.” operationally safe, and operationally efficient service
SkySkopes scouted for what jobs it could, and one provider.”
of them turned out to be flying at the groundbreaking Going forward, the company wants to expand its
of the Grand Sky complex, which Dunlevy says was service offerings and the types of flights it can do
“one of the first commercial SUAS missions on a U.S. — Dunlevy says SkySkopes is “absolutely ravenous
military installation.” to get to beyond visual line of sight” and he supports
The company went on to be the first to fly under the push from AUVSI and the Federal Aviation
Part 107 in the state and to get its waiver to fly at Administration to get there.
night, and in the next couple of years went through “We stand shoulder to shoulder with AUVSI in the
its “industrializing days,” where it moved from “onesy- advocacy of the new technologies and in the advocacy
twosy” jobs to steady emergency response work and of new regulatory frameworks.”
beyond line of sight missions.
“A lot of this stems from the world-class UAS talent
at the University of North Dakota,” where the company
gets many of its pilots, he says.
In the few years since its founding, SkySkopes
has set up offices in the major cities in North Dakota
and also in Minneapolis, Fort Worth and Denver and
We stand shoulder to shoulder with
will soon establish footprints on both coasts and in
major metropolitan areas. It has gone from four initial
AUVSI in the advocacy of the new
employees to a few dozen and their willingness to technologies and in the advocacy
travel means “our service footprint is one of the most
wide-ranging in the industry,” Dunlevy says. of the new regulatory framework.
“We’re able to fly in any of the continental United
States due to the geographical spacing of our
corporate offices, and that we did this in an organic
fashion I think is remarkable.” he says. “We didn’t know
exactly how this was going to shake out, but we knew
SEPTEMBER 2019 | UNMANNED SYSTEMS | 13
Q&A
Lt. Gen. Todd Semonite assumed his position as Chief of Engineers and
Commanding General of the U.S. Army Corps of Engineers (USACE) on
May 19, 2016.As the USACE commanding general, he is responsible
for more than 32,000 civilian employees and 700 military personnel
who provide project management, construction support and science
and engineering expertise in more than 110 countries.
Q: What do you see as the main benefits potentially harmful environments or dangerous
behind expanding unmanned systems use by munitions that might be at the dredge site.
the U.S. Army Corps of Engineers (USACE)?
Q: How do you intend to implement the
A: The mission of the U.S. Army Corps of Engineers growth of unmanned systems use by USACE?
is to solve the nation’s toughest engineering What guidance have you given the field
problems. To do this, we have to maintain commanders?
technical relevance in our many disciplines and
unmanned systems are a growing segment A: USACE has been growing unmanned
of the engineering ecosystem. The principle systems use for years. This work was done
benefit for USACE is to maintain our position locally at the district offices. During our
as a world-class engineering organization. This Executive Governance Meeting in the Summer
includes the significant potential for time and of 2018, at the recommendation of our senior
money savings as well as intangibles such as staff officers, I directed the establishment of
increasing safety for our personnel. our Headquarters Aviation and Remote Systems
UAS get the most attention in the news these Office. This office, located in our Directorate of
days, but USACE is involved in a full spectrum Logistics, works closely with the G3 (operations)
of activities using unmanned and remote and the G6 (chief information officer). One of
systems. Some examples are our unmanned the key activities of the HQ program is to ensure
surface vessels including the Wave Adaptive USACE implements appropriate standards,
Modular Vessel (WAM-V), the Multifunctional training, and oversight of unmanned systems as
Assessment Reconnaissance Vessel (MARV), well as monitors cyber security and other risks
and the Mini Robotic Submersible Dredge related to technology integration. Establishing
(MRSD). our HQ Aviation and Remote Systems Office
The WAM-V and the MARV both provide was a new beginning for growth of unmanned
excellent capabilities for port assessments and technology within USACE.
other missions to support navigation efforts. My goal is to ensure the enabling technologies
The WAM-V carries sonar for subsurface are available to our field operating activities,
maritime assessments and also has terrestrial while, as much as possible, headquarters
lidar equipment on deck. This dual capability manages the risks and administrative
gives engineers and operations personnel a processes. If we make it useful, the field
complete picture with one data collection. The commanders will take care of the growth.
MARV is designed to assess pile-supported
marine structures in a fraction of the time of Q: Do personnel safety factors play a role in
traditional methods and without exposing divers this cost/benefit analysis?
to the hazardous conditions they pose.
The MRSD is a product of our own Engineering A: Absolutely! Personnel safety is a
Research and Development Center’s (ERDC) cornerstone of our operational mindset and one
effort. Even at 40 feet and 25,000 pounds, it of our highest priorities. USACE has made a lot
is truly a miniaturization of traditional dredging of progress implementing safety management
machinery. This system is transportable systems across our operations. To be able to
via airlift and can be deployed worldwide to remove a USACE employee or support contractor
support immediate dredging needs remotely. from a dangerous area and to use a drone or
The benefit is twofold: enabling rapid port or other remote system in their place provides an
channel clearing and removing personnel from immeasurable value. Safety is a top intangible
benefit we see with the use of remote systems, along with trained to conduct a thorough analysis of alternatives and
higher fidelity of collected information, and collection of data to bring the best tool to bear for each job. When the correct
products like full motion video as a byproduct of unmanned tool is an unmanned system, the benefits clearly outweigh
operations. the costs.
Just this year in Nebraska, our Omaha district used their
newly acquired UAS to collect data on several levee systems Q: Were drones or other types of systems used to help aid
along the Missouri River that were overtopped during flooding. recovery in Puerto Rico, and what roles did they play?
Without the UAS, we might have had people venturing into
more dangerous situations to gather information, or we may A: While they were used in isolated efforts, remote
have had less information in the operations center to help systems did not play a major role for USACE in the recovery
us make critical decisions. The same thing happened in the efforts in Puerto Rico. This is one of the issues that
Vicksburg District on the Yazoo River a few weeks before highlighted our need to provide a program similar to those
that. We can’t quantify the measure of safety our people found in other large federal organizations. Our operations
were afforded, but we have no doubt it was there. officer, Col. Dave Hibner, who has been a vocal advocate for
unmanned systems for years, has worked with our aviation
Q: What role do cost considerations play, and do you think program manager to ensure integration into our emergency
the benefits outweigh the costs? support function mission.
The first area to see benefit has been our Blue Roof,
A: We are always focused on providing value to the or temporary roofing mission. The Blue Roof program
nation. We owe it to the customers we support and to the manager incorporated UAS usage in the Hurricane Michael
taxpayers. The commanders and directors in USACE make response with promising results. He has continued to lead
careful, informed decisions to ensure best value for every UAS integration into our emergency support functions
dollar USACE spends. The value of using unmanned systems and has a plan for the next contingency to expand UAS
is unmistakable. When the use of drones or other remote roofing inspection missions as well as to incorporate other
systems is appropriate, we work to realize up to 90 percent technologies that are tangential to UAS use.
reduction in cost over traditional methods, and up to 85 If you run the numbers on Blue Roof in Puerto Rico where
percent time savings for data collection. The intangibles we emplaced over 59,000 missions, a savings of only 30
like safety, increased data resolution, and an enduring data minutes per mission would have reduced the overall workload
record are just icing on the cake. by more than 14 man-years of effort! So, while we didn’t have
The key is appropriate employment of the systems. Our UAS to bring to the Puerto Rico mission, we learned from it
commanders conduct careful cost benefit analysis prior to and are working to be ready for future ESF missions.
acquisition of these systems. Once fielded, our teams are
SEPTEMBER 2019 | UNMANNED SYSTEMS | 15
Q: Are there potential benefits to incorporating monthly. We were behind industry but are quickly closing the
unmanned systems in emergency recovery plans? What gap and expect to be on par within one to two years.
are they? For UAS, the FAA and Department of Defense regulations
have settled down with the implementation of the FAA
A: The potential benefits for emergency support function Part 107 and the new AR 95-1 Flight Regulations. Ground,
missions are the same as they are for normal operations. maritime and aerial unmanned systems all face cyber
Efficiency, accuracy, and safety are the top three that come security threats that we are poised to control with the help
to mind. However, USACE operators have to be proficient and of HQDA [headquarters, Department of the Army] and OSD
have up-to-date equipment to maximize their emergency [Office of the Secretary of Defense]. A significant portion
response capability. of the Headquarters Program efforts during this year have
Our aviation program manager is developing the been focused on ensuring a solid cyber security posture.
unmanned training standards to include the skillsets Industry users of unmanned systems are experiencing
needed for normal and emergency
operations. All our major mission,
civil works, military programs,
and emergency response —
while different — require the
same knowledge and skills. This
ensures all of our remote systems
operators can support whatever
mission comes their way. It also
ensures synchronization between
all our major programs. This
synchronization is a risk factor I
track to ensure military programs
and civil works operations
don’t deviate enough to require
separate programs and all the
inefficiency that would come with
them.
Q: Would you say USACE is ahead of, or behind, A: Well, the warfighting army is clearly
industry in the use of unmanned systems? a leader in using unmanned systems.
Every officer with combat experience has
A: The key step to getting USACE on track with benefited from the intelligence and kinetic
unmanned systems use was the establishment of capability of unmanned aerial systems like
our Headquarters Aviation and Remote Systems the Raven, Shadow, or Gray Eagle. What
Program. This program has removed 80-90 percent we have learned from that experience is
of the administrative burden from our field operations to expect great capability and work to find
and is assisting districts in establishing new programs new ways to employ it.
16 | UNMANNED SYSTEMS | SEPTEMBER 2019
UAS operations in the military have evolved from Q: Where do you see the use of unmanned
merely putting a camera in the sky to providing aircraft and ROVs or other systems in USACE in
security over-watch, delivering equipment three to five years?
or supplies in small quantities, disrupting IED
emplacement activities without direct troop A: I expect the use of these systems will explode
engagement, and many other operations in the coming years. I expected it when I was a
that weren’t even imagined by the early UAS division commander in USACE, and I’m seeing it
developers. happen during my tenure as the 54th U.S, Army
We need to do the same thing with unmanned Chief of Engineers. We are already flying hundreds
technology in engineering operations. An example of survey and mapping missions every year and I
of this innovation is a needed turbine inspection expect that number to continue to increase.
at one of our dams in the Portland District. The USACE has initiatives to use UAS to improve
facility manager was going to have to close the Blue Roof responsiveness, support flood fighting
penstock and drain the turbine chamber to allow operations across the country, map undersea
a person or UAS to get under the turbine and terrain (bathometry) for coastal management,
inspect it. However, our remote system operator Jason Kirkpatrick, and the list goes on.
there, Todd Manny, recommended a novel solution; aviation and remote There is potential in every mission we
use of a tethered submersible system to swim in systems program execute. Be it use by our park rangers, public
under the turbine and inspect it using sonar rather manager, reviews affairs, facilities managers, security personnel,
a senseFly eBee X construction managers, or countless others with
than a camera. This eliminated the need to drain
fixed-wing drone with
the chamber and reduced the risk of injury or loss the imagination to innovate. Some have direct,
Lt. Gen. Semonite
of the UAS that would have occurred if it fell into as Jeffrey Burbach, tangible benefits that can be attributed to cost
the water. USACE director of savings, and all missions have intangible benefits
We leverage the work of the Army’s Project logistics, looks on. that range from increased personnel safety
Management office for UAS to bring their best Photo: Phil Tintner to being able to provide data that would have
products to our fleet where it makes sense. Our previously remained unavailable.
aviation team is located near Redstone Arsenal There is no limitation to where we will be in three
for proximity to the Army aviation
acquisition efforts there. One of our
aviation team members interfaces
with the PM UAS small range
reconnaissance (SRR) team on a
regular basis.
Industry interest
As indicated by ASAE, industry interest
in using TOP for UAS operations is growing
across a variety of sectors.
Anadarko Petroleum Corp. of The
Woodlands, Texas, is evaluating the TOP
program and, if things go as expected,
plans to start deploying it in the next
month for the company’s internal pilot
fleet and pilots from external vendors.
“We have about 43 to 45 internal
pilots and we’re looking for a way to
quantitatively assess and grade their
skills as an operator,” says Wane Rodieck,
Anadarko’s aerial and visual analytics
manager. “We were looking for something
that went above and beyond Part 107. The
AUVSI TOP program was a great next step
for us.”
Anadarko plans to have all its pilots TOP
Level 2 certified by the end of the year,
Rodieck says, with some to advance to
Level 3 for more industry-specific training.
Anadarko uses its fleet of drones all over
the world, to monitor construction, detect
pipeline leaks, create orthomosaics for its
well sites and other uses. The company
works with four outside vendors but does
DARTdrones, a training company that was an early adopter of the TOP program, about 95 percent of its drone work in-
says enterprise users are becoming more attracted to drone pilot certification. house. All of the Anadarko pilots fly part-
Photo: High Class Studios
time, he says, using the UAS as a tool to
help them do their jobs.
AUVSI recently took home a Power of A (Association) Gold Award from ASAE, “Drones are allowing us to understand
the Center for Association Leadership, for its Trusted Operator Program (TOP), what we have in the field much more
now almost a year old. comprehensively than we were [able to]
TOP is a certification program aimed at creating a culture of safety, reliability, with our two-dimensional data,” Rodieck
professionalism and trust within the UAS community. says.
“We applaud AUVSI for creating and implementing such a collaborative Rodieck started the company’s drone
initiative that strengthens society,” says Sharon J. Swan, CEO of the American program and was its only pilot for a couple
Society for Clinical Pharmacology and Therapeutics and chair of the Power of of years. Now Anadarko has a fleet of 52
A Awards Judging Committee. “Their initiative exemplifies how no other sector UAS, made of up various models from DJI,
helps improve lives as comprehensively as the association community.” including Phantom 4s, Matrice 200s and
There are now more than 100,000 drone pilots certified by the Federal 600s, and Mavics.
Aviation Administration and that’s just since the regulations went into effect in Before coming to TOP, the company
2016 to allow commercial flight. required its pilots to be Part 107 certified
ASAE notes that although it was created to begin domestically, TOP has and then had its own induction training.
drawn interest from around the world, including Australia, Canada, Mexico, “However, there was nothing really
Rwanda, South Africa and the United Kingdom. In addition, three significant structured around the training and
enterprise users — a leading insurance company and two of the top 10 U.S. certification of those pilots and the
electric utilities — are in the process of adopting policies that would only allow company that we’re working with now, it’s
TOP-certified remote pilots to carry out their UAS operations. much more comprehensive than anything
18 | UNMANNED SYSTEMS | SEPTEMBER 2019
we put together,” Rodieck says. “So, “All of our flight ops pilots are TOP
we’re seeing a lot of value out of the 1 and a handful of investigators have
TOP certification and training process.” taken the Dart course,” he says, which
It’s going to
The company expects its drone use is “but one of many training courses
to expand in the future, as it is merging that we use.”
with Occidental Petroleum Corp., As for the critical importance of
effectively doubling the size of the training, English writes, “I often tell take some
company. people that a UAS program budget
“We do anticipate with the doubling should be roughly 25 percent flight time, but TOP is
of the size of the company that we equipment, 25 percent support
would double our staff, we would equipment/software, and 50 percent well positioned
double our aircraft, so we are expecting training. Everybody focuses on the
to grow,” Rodieck says. gadgets. Wrong, wrong, wrong.” to be adopted
Training is the bedrock Enterprise interest as the industry
The National Transportation Safety
Board is also using TOP to help
DARTdrones recently published a list
of six reasons why enterprise drone
standard.
backstop its training.
Bill English, the investigator-in-
operations are becoming interested in
TOP (DARTdrones is a Level 3 training
–DARTdrones
charge in the Major Investigations provider and early adopter of the
Division of the Office of Aviation program).
Safety, said in an email exchange with
• It’s a differentiator: There are
Unmanned Systems that NTSB needs
thousands of certified Part 107
its investigators to be trained on the
pilots, but it can be difficult to identify
technology to conduct investigations
the ones who are truly qualified and
of UAS mishaps, and operational
experienced.
training for flight operations officials to
• It provides a true industry standard —
conduct multimodal mission support.
more than 200 indusry leaders created An Anadarko optical gas imaging technician
“Training is the bedrock of any
the consensus standards in the TOP flies the Optical Gas Imaging drone,
aviation operation,” he says.
Protocol Certification Manual. conducting a wellsite emissions inspection.
Having the TOP Protocol Certification
• It fills in “missing pieces” of Part 107, Photo: Anadarko Petroleum Corp.
Manual “is a great guide to bounce our
which DARTdrones covers in 14 online,
procedures off of, to make sure we
scenario-based microcourses covering
have ‘covered all the bases,’” he says,
things like weather assessement,
although it’s not the only source for
equipment care and maintenance and
that.
aviation communications.
The NTSB has worked with
• It provides a vetted flight assessment.
DARTdrones’ Real World Flight Planning
• TOP Level 3 includes a functional area
and Execution as an “excellent ground
breakout aimed at specific industries.
school,” which qualified the attendee
• It improves internal pilot team “buy-
for TOP Level 1, English writes.
in.”
Robotic Skies, based in Albuquerque, overlooking the approach to San missions, such as flying beyond line of
New Mexico, is based on the notion Francisco International Airport. sight.
that the growing fleet of unmanned “I spent four years running a global He realized “when that happened,
aircraft in the skies all have one thing program. I had teams all over the world, those aircraft were going to have to
in common — they’re going to need so I was on calls all hours of the day and be maintained and they were going to
maintenance. night, and I was watching the planes have to be maintained in a central way
Brad Hayden, the company’s founder, landing at SFO for all that time. And I to best assure safety and reliability, so
grew up in aviation, in what he calls a thought, oh my gosh, I want to get back we didn’t have an incident.”
“Part 145 repair station environment” into aviation,” Hayden says. He conducted a year’s worth of
(Part 145 of the Federal Aviation He got back into the industry via a market analysis and “determined there
Administration’s Code of Federal startup avionics company, but also got was an opportunity there to leverage
Regulations Title 14 governs aircraft into the unmanned side of things by these exact Part 145 repair stations
maintenance and inspection facilities). joining the multirotor drone community that I grew up in.”
“I started working on airplanes when “back when it was still kind of DIY. In 2014, Hayden launched Robotic
I was pretty young, and it was like my So, you’re building these things from Skies, a company that serves as a
high school job, if you will,” he says, and kits, you’re not even able to buy one broker network to those Part 145 repair
continued in college. complete, pretty much.” stations.
He worked in marketing for various Hayden said he realized drones were “The reason why I chose to go with
high-tech companies for years and only going to become more complicated the Part 145 repair stations is exactly
eventually found himself in an office and be able to take on more complex why we do it in manned aviation,”
Worldwide network
Robotic Skies now has a network of more
than 170 repair stations across 40 countries
— the ones overseas aren’t covered under
Part 145 but have the local equivalent
certification. It works with companies to design
a maintenance regime for their drone fleets,
including maintenance intervals, then provides services for commercially focused regulatory
that to the maintenance centers, which are well compliance, ground support, training, MRO,
versed in all types of aircraft from business jets The company works parts distribtution, field upgrades and vehicle
on down. with customers to retrofit capabilities.
“So, the beauty to our manufacturer design a maintenance “The industry is starting to understand
customers and our operator customers is regime for their drone that this is, you know, how the FAA is going to
they don’t have to go out and implement a fleets, including
approach it,” Hayden says of drone maintenance.
formalized maintenance program and recruit maintenance intervals,
then provides that “So, as they get more clarity around that, they
a whole bunch of service centers to be able are absolutely going to realize that they’re going
to the maintenance
to maintain their aircraft in the field — we’ve to need maintenance at the level that we offer.”
centers.
already done that,” he says. When he first got into drones, and first-
“Our biggest value proposition is that we person-view control, Hayden said he realized
offer one global solution, but we offer it on a that drone technology could also make manned
local scale,” Hayden says. aviation safer.
Robotic Skies will even take care of “One of the things that really fascinated
pickup and delivery of aircraft that are too me was how a lot of the technology, including
big or expensive to ship. It works with larger, accelerometers and GPS and navigation controls
commercial unmanned systems, not smaller ... was actually a lot of the same technology we
consumer products made by companies like were putting into our manned aviation products.
DJI, which has its own maintenance program. And I recognized that, this was truly going to be a
The tiny company — currently five people, disruptor to the aviation industry. And you know,
but they’re hiring — works with a variety of aviation is not an easy industry to disrupt.”
customers, including Pulse Aerospace, uAvionx,
Black Swift Technologies, Iris Automation,
Alpha Unmanned Systems and others, and
recently drew the attention of aerospace Customers include Pulse Aerospace, uAvionx, Black Swift
industry heavyweight Boeing, which announced Technologies, Iris Automation, Alpha Unmanned Systems and others.
an investment in the company, although few
details were provided.
“With safety as a cornerstone, we are
shaping a robust operational ecosystem for
on-demand mobility that supports the future
of aircraft, air vehicles and autonomous
systems,” Brian Schettler, managing director
for Boeing HorizonX Ventures, said in a June
announcement.
Boeing, and its subsidiaries Jeppesen
and Aviall, had previously teamed with
Robotic Skies to support its core work for
delivering maintenance and repair for civil
and commercial UAS, a pairing announced in
the fall of 2018. Boeing and Robotic Skies
are jointly pursuing opportunities to provide
Commercial deliveries
Startup Kodiak Robotics has begun making driverless
deliveries, albeit with a safety driver behind the wheel.
Meanwhile, just 16 months after forming, self-driving truck
Photo: Kodiak Robotics
startup Kodiak Robotics Inc. announced it has started making
its first commercial deliveries with a safety driver behind the
Whether on highways or sidewalks or in the air, unmanned wheel. Kodiak has also announced its new facility in North
systems are increasingly being used to deliver packages across Texas, which will help the company support its growing testing
the United States and around the world. and freight operations.
Digital freight broker Loadsmart and autonomous truck “In just over a year, we’ve gone from founding Kodiak to putting
startup Starsky Robotics recently announced they were able our trucks on the road and hauling freight for customers,” says
to automatically dispatch an autonomous truck to haul freight. Don Burnette, CEO and cofounder of Kodiak Robotics. “Making
Loadsmart successfully priced, tendered and booked the such rapid progress wouldn’t be possible without our strong,
dispatchment, while Starsky’s self-driving technology was experienced team, who’ve been working with autonomous
used to pick up and deliver the shipment. There was no need vehicles since the early days of the industry.”
for human intervention during this process, thanks to the With a goal of revolutionizing long-haul trucking, Kodiak says
integration of Loadsmart’s artificial intelligence-powered it operates as a “true freight carrier,” as its self-driving trucks
pricing and load matching technology with Starsky’s API. operate on “middle mile” highway routes. Since launching in
According to Loadsmart and Starsky, this initiative is part April 2018, Kodiak has not only launched freight operations for
of a “larger strategic partnership” that paves the way for the customers in Texas, but has also expanded its fleet of trucks.
future of trucking, which will consist of autonomous brokerages
dispatching freight to autonomous trucks without human Scout deliveries
involvement.
“Today, for the first time ever, the advances that seem In Southern California, Amazon’s Scout delivery robots hit
obvious for the ride-sharing services are coming to trucking,” the ground in early August to deliver packages to customers.
says Stefan Seltz-Axmacher, CEO and founder of Starsky To start, a small number of Scout robots will make deliveries
Robotics. Monday through Friday during daylight hours.
“It’s not uncommon for a traditional trucking company to Amazon says customers in the Irvine, California, area can
have five full-time employees involved in dispatching each order things the way they normally do, and their Amazon
truck for each load. By integrating e-brokers like Loadsmart, we packages will be delivered either by one of Amazon’s carrier
are eliminating all back office human intervention and making partners or by an Amazon Scout. The same delivery options are
24 | UNMANNED SYSTEMS | SEPTEMBER 2019
Amazon’s Scout delivery robots, having been tested
in Seattle, are now making deliveries in Southern
California. Photo: Amazon
The United States currently enjoys a significant advantage inform the Navy of industries’ positions, to help the U.S.
in the undersea realm, but according to Christine Fox, senior maintain its advantage.
adviser at the Johns Hopkins University Applied Physics “By meeting with department leaders who prioritize
Laboratory, it is “absolutely the focus of competition and it UMS, the committee can act as an industry liaison and
is critically important from a national security perspective provide an external viewpoint on concepts like acquisition
that we not get complacent, especially since this is one of strategy, autonomy export controls, cybersecurity, and IT
the best deterrents that we have from any kind of hostility infrastructure,” Smitsky says. “As a result, industry can act
in the world.” as an accelerant and help the Navy adjust their focus where
For Fox, maintaining this advantage is a matter of necessary.”
creativity. Commercially, unmanned vehicles and robotics have the
“We need more, and we need more innovation in this realm,” potential to impact a number of industries such as oil and
Fox, who previously served as the acting deputy secretary gas, energy and aquaculture.
of defense, said during the 5th Annual Entrepreneur Forum From a commercial integration standpoint, one of the
in Woods Hole, Massachusetts in mid-July. biggest hurdles are the COLREGs. Traditionally, these set
“I think that unmanned underwater vehicles are really a of regulations provide the “rules of the road” for vessels
key to this, and I do believe that the department is waking to prevent collisions, but due to the increased presence of
up to that fact,” she said.
According to Mike Smitsky, AUVSI’s manager of advocacy
and government relations, maintaining this advantage will
also require the U.S. Navy continuing to prioritize unmanned
maritime systems (UMS) programs in its annual budget
requests.
Smitsky, who also manages and staffs AUVSI’s UMS
Advocacy Committee, notes that in fiscal year 2020,
the Navy requested several funding increases for UUV
programs, but that is just the start of a much longer
process.
“These ambitious requests demonstrate leadership
recognition that UUVs are critical to both the security
of the country and the future complexion of the
Naval fleet architecture. However, the battle
does not end here. These requests must be
authorized and appropriated,” he says.
Both the National Defense Authorization
Act and the Defense Appropriations Act
need to match the initial budget requests to
materialize the Navy’s vision. While the final
product does not always match the initial
requests, the UMS Advocacy Committee
can help in this process by educating House and Senate
offices who sit on the Armed Services and Appropriations
committees on the significance of UMS to the future of the
Navy.
“This process of consistently raising awareness about
the importance of UMS technologies to the security of
the nation ideally will help appropriations mirror the initial
request by the Navy,” he says.
He adds it is important to effectively articulate what
the Navy’s overall intent is with these programs, because
if congress doesn’t understand the context, it won’t fund
During the 5th Annual Entrepreneur Forum in Woods Hole,
these programs.
Massachusetts, Sea Machines demonstrated its autonomous
With the Navy being such a large entity with so much vessel. All Photos: AUVSI
on its plate, the UMS Advocacy Committee wants to help
28 | UNMANNED SYSTEMS | SEPTEMBER 2019
UMS, COLREGs require “substantial updating,” Smitsky
says.
The rules are published by the International Maritime
Organization (IMO), which recently met to discuss
autonomous vessel integration and COLREGs. The U.S.
It is critically important
representative on the IMO is the United States Coast
Guard, which has previously received industry input on
from a national security
what these updated rules should take into consideration.
Other pieces of legislation include the Commercial
perspective that we
Engagement Through Ocean Technology (CENOTE) Act not get complacent,
of 2018, and the Coast Guard Authorization Act of 2019,
which the U.S. House of Representatives approved in late especially since this
July. The bill moved to Senate at the time of publishing.
Signed into law Dec. 21, 2018, the CENOTE Act of is one of the best
2018 encourages partnerships between academia,
the private sector, and the government in the realm of deterrents that we have
ocean observation. The CENOTE Act of 2018 authorizes
the Department of Commerce’s National Oceanic and from any kind of hostility
Atmospheric Administration (NOAA) to “evaluate the use
of unmanned maritime system technology for use in data in the world.
collection.”
Meanwhile, the Coast Guard Authorization Act of
–Christine Fox
2019 (CGAA 2019) is legislation that “reauthorizes
appropriations for the Coast Guard and Federal Maritime
Commission through Fiscal Year 2021.”
The bill also includes “regulatory improvements
to promote the U.S. maritime industry and offshore
renewable energy development, ongoing authorization
of funding to build new polar security cutters (heavy ice Tend Ocean demonstrates its Drone Tug during the 5th Annual
Entrepreneur Forum.
breakers), new requirements for the
Coast Guard to assess and evaluate
unmanned technologies for potential
use in Coast Guard operations,
provisions to increase diversity at the
U.S. Coast Guard Academy, and new
maritime safety enhancements.”
AUVSI’s UMS Advocacy Committee
played an influential role on section
416 of this bill, which “directs the
Commandant of the Coast Guard to
develop a plan for a demonstration
program that will assess the feasibility
of using unmanned maritime systems
for surveillance of marine protected
areas and to submit a report to
Congress on that plan.”
“Both of these bills are legislative
vehicles that provide additional
authorities for NOAA and the USCG
to deploy UMS technology,” Smitsky
says.
Collaboration
and innovation
One vehicle that has
helped the U.S. maintain its
advantage in the undersea
realm thus far is the Remote
Environmental Monitoring UnitS
(REMUS) AUV, designed for ocean
research.
Developed by Woods Hole
Oceanographic Institution (WHOI) in
Falmouth, Massachusetts, REMUS
SEPTEMBER 2019 | UNMANNED SYSTEMS | 29
was originally developed for coastal During his 35-year career with the Navy, Mike Connor, the founder, president
monitoring, but it can also be used and CEO of ThayerMahan, rose to the rank of vice admiral. Connor led the
for other tasks such as surveying and U.S. Navy Submarine Force’s move into robotic undersea systems, achieving
mapping, “traveling methodically over several milestones along the way, including the first operational deployment
an area like a lawnmower to sample key and recovery of an unmanned vehicle from a submarine.
ocean characteristics,” according to During the Entrepreneur Forum, Connor described the ocean as “an
WHOI. increasingly crowded place.”
Falmouth was the site of the 5th Annual Trying to conduct various tasks such as growing and catching food, or
Entrepreneur Forum that focused on harvesting wind energy, has become increasingly difficult against the backdrop
defining the challenges facing the marine of shipping traffic that has gone up about 400 percent in the last 15 years, and
robotics’ industry and framing initiatives the fact that there are a lot of new threats out there.
that the industry could undertake as a “In order to do all those things in the same space, without having disaster
collective to accelerate progress. strike, we have to do all those things more precisely and with better
REMUS is manufactured commercially information,” Connor said.
by the WHOI spinoff company Hydroid, a With that in mind, ThayerMahan focuses on developing systems that that
subsidiary of Kongsberg Maritime. can go to sea for 90 days or more at a time. The company finds vehicles,
With the potential for so many use generally off the shelf, and put payloads on them “to do useful things for what
cases, the Navy purchased REMUS and we think will be actual paying customers,” Connor said.
decided to use it for mine warfare, an area When offering fellow entrepreneurs in the room advice on how to establish
that has plagued the U.S. forever, Fox said,
because mines are very low cost, making
them easily accessible for any adversary
that wants to cause harm to the U.S.
With this in mind, the Navy decided to
adapt REMUS for mine warfare. Renaming
it Mk 18 Mod 1, the AUV was fielded
and proved very successful in helping
advance mine warfare. During Operation
Iraqi Freedom in 2003, the U.S. Navy
used REMUS vehicles to detect mines
in the Persian Gulf harbor of Umm Qasr.
Navy officers said they preferred REMUS
AUVs because each could do the work
of 12 to 16 human divers, and they were
“undeterred by cold temperatures, murky
water, sharks, or hunger,” according to
WHOI’s website.
Working in partnership with the
operational community, the Navy
upgraded Mk 18 Mod 1, resulting in Mk
18 Mod 2, which was possible due to the
vehicle’s modularity.
Johns Hopkins’ Applied Physics
Laboratory is also taking advantage of
REMUS’ modularity, as it is injecting deep
learning algorithms into the vehicle to
help identify mines and achieve a lofty
goal it has set regarding mine warfare.
“Our aspirational goal at APL is to be
able to clear a minefield as fast as an
adversary can lay it,” Fox said.
While aspirational, improving the ability
to do the target recognition is a “very,
very important first step,” Fox added.
Lessons learned
To help “accelerate the United States’
ability to effectively and efficiently
monitor ocean activity using autonomous
systems,” one Navy alumnus has taken
the lessons learned during a prolific
career and is implementing them through
a company called ThayerMahan Inc.
RULES TO OVERSEE THE BOOMING into law in October, granted the FAA
authority to develop the rule.
Jay Merkle, executive director of the
UNMANNED AVIATION SECTOR FAA’s UAS Integration Office, told the
agency’s Drone Advisory Committee in
By Marc Selinger June that a final rule is likely up to two
years away.
“This is a complex rule, and the FAA
The FAA’s efforts to oversee agency defines as “the ability of a has been working diligently to draft
commercial and recreational UAS in flight to provide identification a rule that meets legal requirements
unmanned aircraft systems seem to information that can be received by and provides the most comprehensive
be growing almost as quickly as the other parties.” proposal to enable the next phase of
industry itself. UAS operations,” the FAA told Unmanned
With more than 1.4 million UAS now ‘Key enabler’ Systems in a written response to
registered with the FAA, a statistic questions.
Remote ID will allow law enforcement
that did not even exist until a few In the meantime, the FAA is exploring
officers to determine the location of
years ago, the agency is pursuing whether UAS manufacturers or
an errant UAS and its control station.
several regulatory and other initiatives operators could voluntarily equip UAS
It will also help pave the way for more
to manage the increasing traffic to with Remote ID.
complex operations, including flights
ensure safe and efficient operations. Some lawmakers want the FAA, which
over people and beyond-visual-line-of-
“This is a fast-moving industry, and has been working on Remote ID for
sight flights.
we’re doing our level best to keep up,” years, to move more quickly. In an April
“I think that the Remote Identification
then-acting FAA Administrator Daniel letter to Transportation Secretary Elaine
rule is a key enabler of really the next
Elwell said in a June speech. “The trick Chao, Sens. Edward Markey (D-Mass.)
step of integrating unmanned systems
is to mitigate safety risks without and John Thune (R-S.D.), both members
into the airspace,” Stephen Dickson,
putting the cuffs on technological and of the Senate Commerce, Science and
approved Aug. 12 to head the FAA,
operational advances.” Transportation Committee, urged the
testified at his confirmation hearing
Chief among the FAA’s activities FAA to “swiftly publish” the proposed
before the Senate Commerce, Science
is Remote Identification, which the rule, citing recent drone sightings at
and Transportation Committee in May.
32 | UNMANNED SYSTEMS | SEPTEMBER 2019
major U.S. and British airports and Boston’s Fenway Park At press time, the task force, which is
baseball stadium. cochaired by former FAA Administrator
The FAA is working on
“Remote identification will enhance safety, security rules to allow drones Michael Huerta and Los Angeles World
and privacy, and serve as a critical tool for law to fly over people. Airports CEO Deborah Flint, was slated
enforcement to respond to and address reports of Photo: AUVSI to release a more-detailed report in
illegal and unauthorized drone operations,” the senators September.
wrote. Since malicious operators, such as
Exactly how the FAA will implement Remote ID terrorists, could try to conceal their
technologically is unclear. In September 2017, an FAA- identification, the FAA continues to
chartered panel, the UAS Identification and Tracking explore systems that could detect and
Aviation Rulemaking Committee, recommended two mitigate UAS at airports. Stubblefield
methods: direct broadcast, in which a drone sends out said the agency plans to test such
data that anyone in broadcast range can receive, and technology at several airports.
network publishing, in which a drone sends data to an “The FAA is in the process of setting up a program and timeline,
Internet service or federation of services. In December using a methodical and iterative approach to ensure it provides
2018, the FAA issued a request for information to form valuable data to the FAA, other government agencies at all levels,
an “industry cohort” to explore potential technological vendors of UAS detection and mitigation systems, and potential
approaches for Remote ID. users,” the agency said. “We are still determining the selection
The Blue Ribbon Task Force on UAS Mitigation at process for the airports and systems at this time.”
Airports, formed by the Airports Council International- Spurred by Congress, the FAA is also developing standards for
North America (ACI-NA) and AUVSI, has urged the FAA the eventual widespread deployment of counter-UAS systems.
and Transport Canada to make Remote ID interoperable Although the FAA has already tried out detection systems at
with air traffic control (ATC) systems so that a drone’s ID four airports, that pilot program, which took place from February
and position information could be sent automatically to 2016 to December 2017, revealed that such technology was
ATC and public safety personnel. not ready for mass deployment. Experts say each kind of sensor
In an interim report released in July, the task force has limitations and that fielded systems will need to integrate
also suggested making Remote ID “interoperable several types of sensors to avoid gaps in coverage.
internationally” so it works in countries besides the With some airports trying out UAS detection systems on their
United States and Canada. own, the FAA sent out “informational correspondence” in May
In addition, the task force recommended the FAA and cautioning airports about using such systems, Stubblefield said.
Transport Canada not exempt hobbyists from Remote Among the FAA’s concerns is that such systems might produce
ID and consider requiring manufacturers and retailers to inaccurate information that could spur “a reaction that is more
include Remote ID in their products. detrimental than the errant UAS itself.”
MANAGING AUTONOMY:
REGULATORS SEEK TO PROMOTE THE AV INDUSTRY,
BOOST SAFETY, PROTECT SPECTRUM By Brett Davis
words driver and operator “to recognize that such terms do
not refer exclusively to a human, but may in fact include an
automated system.”
AV 3.0 expands its look at automated vehicles to include
commercial vehicles and infrastructure and reaffirms
the previous direction that the DOT will rely on a self-
certification approach, rather than vehicle type approval, as
a way to “balance and promote safety and innovation,” and
will push this approach to the international community.
It also says the DOT will continue to work to preserve
the ability of transportation safety applications to function
in the 5.9 GHz spectrum, something that was mentioned
by every government speaker at the Automated Vehicles
Symposium.
Spectrum squabble
The 5.9 GHz band traditionally has been reserved
for vehicle-to-vehicle communication, but the Federal
Communications Commission has for years been eyeing
Ray Martinez, administrator of the Federal Motor Carrier Safety part of it for other uses, including faster wi-fi.
Administration, said his agency is seeking to remove outdated “I believe that the time has come for the FCC to take
regulations on self-driving trucks. All photos: AUVSI
a fresh look at this band,” FCC Chairman Ajit Pai said in a
speech at the Wi-Fi World Congress in Virginia in May. “We
Automotive industry regulators, in the United States in particular, should open up a rulemaking proceeding, seek comment on
are seeking to remove regulatory restrictions on the development various proposals for the band’s future, and use the record
and testing of autonomous vehicles without compromising job No. that we compile to make a final decision on how the band
1 — safety. should be allocated.”
“There is widespread recognition that automated vehicles will He noted the band has been reserved for vehicular
coexist with conventional vehicles and at some point operate communications and maybe that should still be the case,
side-by-side with them on the highways,” said Nicole Nason, but added, “I am quite skeptical that this is a good idea.”
administrator of the Federal Highway Administration (FHWA), Instead, Pai said the spectrum could be shared between
one of several government speakers at the Automated Vehicles vehicle-to-vehicle uses and unlicensed devices such as cell
Symposium held in Orlando in July. phones and internet providers, some of it could be reserved
“And to this point, I want to affirm the department’s position this for V-to-V communications, “or we could allocate the entire
morning regarding freedom of the open road. We want to protect 75 MHz band exclusively for unlicensed use. Making the
the freedom of all Americans to make mobility choices that best right choice won’t be easy.”
serve their needs,” she said at the event, cosponsored by AUVSI Transportation speakers at the symposium said the
and the Transportation Research Board. spectrum needs to be available for automated vehicles.
The Department of Transportation updated its automated vehicle “The department wants to ensure there is sufficient
guidance last fall to the 3.0 version, which provides guidance on bandwidth for automated vehicles to operate,” Nason said.
technology development and managing safety risks and “clarifies “The 5.9 Ghz band is of “critical importance to us” to reduce
roles to avoid the conflicting patchwork of regulations that hamper crashes, injuries and fatalities — “that’s why we call it the
innovation and provide best practices.” safety band.”
The latest version reaffirms statements from earlier versions Ray Martinez, administrator of the Federal Motor Carrier
that the DOT will prioritize safety, remain technologically neutral — Safety Administration, which regulates commercial
that is, it won’t specify any particular technology or system — and trucking, echoed that point when he spoke at the
will modernize regulations, including by getting rid of current ones Automated Vehicles Symposium.
that may be outdated. “We must ensure that the use of the safety band is
The guidance notes that going forward, DOT will interpret the protected,” he said. “We believe that is critical.”
The band is used for vehicle-to-vehicle communication,
VOLZ SERVOS
German manufacturer of actuators since 1983 – 36 years of innovation
DA 3
6-LP
VOLZ-SERVOS.COM
38AUVSI_HP_hor_171_45x114_Sept.indd 1
| UNMANNED SYSTEMS | SEPTEMBER 2019 28.07.19 19:47
An invaluable resource for innovation,
product development and R&D.
RIDGE AND VALLEY ROCKY MOUNTAIN SAGUARO SAN DIEGO LINDBERGH SEAFARER
USA-OK
JOIN AUVSI
For information on joining a chapter, contact:
Amanda Bernhardt, Chapter Relations Manager
abernhardt@auvsi.org
Researchers at MIT say they have developed a Currently, robots attempt to identify objects
technique that allows robots to quickly identify in a point cloud by comparing a template object,
Finding an object
objects hidden in a three-dimensional cloud of in a point cloud
i.e. a 3-D dot representation of an object such as
data. can be tricky for a rabbit, with a point cloud representation of the
According to the researchers, sensors that vision systems, but real world that may contain that object.
collect and translate a visual scene into a matrix MIT researchers The template image includes collections of
of dots help robots “see” their environment. The have developed dots — also known as features — that indicate
researchers note, though, that conventional a technique that characteristic curvatures or angles of that
techniques that try to pick out objects from such allows them to find object, such as the ear or tail of the bunny. Similar
hidden objects
clouds of dots, or point clouds, can do so with features from the real-life point cloud are first
quickly. Image: MIT
either speed or accuracy, but not both. extracted by existing algorithms, and then those
With the new technique developed by MIT algorithms attempt to match those features
researchers, it takes a robot just seconds from and the template’s features, and ultimately
when it receives the visual data to accurately pick rotate and align the features to the template to
out an object that is otherwise obscured within determine if the point cloud contains the object
a dense cloud of dots, such as a small animal. in question.
This technique can help improve a variety of The point cloud data that streams into a robot’s
situations in which machine perception must be sensor includes errors, though, as the dots are in
both speedy and accurate, the researchers say, the wrong position or incorrectly spaced, which
including driverless cars and robotic assistants can cause great confusion in the process of
in the factory and the home. feature extraction and matching. Consequently,
“The surprising thing about this work is, if I ask robots can make a lot of wrong associations
you to find a bunny in this cloud of thousands — or “outliers,” as researchers call them —
of points, there’s no way you could do that,” between point clouds, which ultimately leads to
says Luca Carlone, assistant professor of the misidentification of objects, or missing them
aeronautics and astronautics and a member of entirely.
MIT’s Laboratory for Information and Decision According to Carlone, state-of-the-art
Systems (LIDS). “But our algorithm is able to algorithms can recognize the bad associations
see the object through all this clutter. So, we’re from the good once features have been matched,
getting to a level of superhuman performance in but this can take an “exponential” amount
localizing objects.” of time. While accurate, these techniques
42 | UNMANNED SYSTEMS | SEPTEMBER 2019
are “impractical” for analyzing larger, real-life datasets object in a point cloud.” So the MIT team has developed a
containing dense point clouds, researchers say. “convex relaxation” algorithm that simplifies the topographic
Other algorithms that can quickly identify features and map, with one single valley representing the optimal rotation.
associations “do so hastily,” which creates a lot of outliers or “In this way, the algorithm is able to quickly identify the
mis-detections in the process, without being aware of these rotation that defines the orientation of the object in the
errors, the researchers say. point cloud,” the researchers say.
“That’s terrible if this is running on a self-driving car, or With its approach, the team says that it was able to quickly
any safety-critical application,” Carlone says. “Failing without and accurately identify three different objects hidden in
knowing you’re failing is the worst thing an algorithm can do.” point clouds of increasing density. The team was also able
to identify objects in real-life scenes, including a living room,
in which the algorithm was able to quickly spot a cereal box
Pruning outliers and a baseball hat.
Because the approach can work in “polynomial time,” it
With this in mind, Carlone and graduate student Heng Yang
can be easily scaled up to analyze even denser point clouds,
have developed a technique that “prunes away” outliers
which resembles the complexity of sensor data for driverless
in “polynomial time,” which means that it can do so quickly,
cars, for example.
even for increasingly dense clouds of dots. As a result, the
“Navigation, collaborative manufacturing, domestic
technique can quickly and accurately identify objects hidden
robots, search and rescue, and self-driving cars is where we
in cluttered scenes.
hope to make an impact,” Carlone says.
Conventional techniques were first used by researchers
to extract features of a template object from a point cloud.
After this, the researchers developed a three-step process
to match the size, position, and orientation of the object in a
point cloud with the template object, while at the same time
identifying good from bad feature associations.
To prune outliers and match an object’s size and position, Navigation, collaborative
researchers developed an “adaptive voting scheme”
algorithm. For size, the algorithm makes associations manufacturing, domestic robots,
between template and point cloud features, and then
compares the relative distance between features in a search and rescue, and self-
template and corresponding features in the point cloud. If,
for instance, the distance between two features in the point driving cars is where we hope to
cloud is five times that of the corresponding points in the
template, the algorithm assigns a “vote” to the hypothesis make an impact.
that the object is five times larger than the template object.
The algorithm does this for every feature association, and
–Carlone
it then selects those associations that fall under the size
hypothesis with the most votes, and identifies those as the
correct associations, while pruning away the others.
“In this way, the technique simultaneously reveals the
correct associations and the relative size of the object
represented by those associations. The same process is
used to determine the object’s position,” the researchers
The new technique can improve a variety of situations where
explain. machine perception must be speedy and accurate, such as in
For rotation, the researchers developed a separate self-driving cars. Image: iStockphoto
algorithm, which finds the orientation of the template object
in three-dimensional space.
Researchers says this “is an incredibly tricky computational
task.
“Imagine holding a mug and trying to tilt it just so, to match
a blurry image of something that might be that same mug,”
the researchers say. “There are any number of angles you
could tilt that mug, and each of those angles has a certain
likelihood of matching the blurry image.”
To handle this problem, current techniques consider each
possible tilt or rotation of the object as a “cost,” so the
lower the cost, the more likely that that rotation creates
an accurate match between features. A topographic map
of sorts represents each rotation and associated cost,
consisting of a multiple hills and valleys, with lower elevations
associated with lower cost.
According to Carlone, though, this can easily confuse an
algorithm, especially if there are a number of different valleys
and no discernible lowest point representing the “true, exact
match between a particular rotation of an object and the
SEPTEMBER 2019 | UNMANNED SYSTEMS | 43
AUVSI members saved an average
of $3,574 in 2018 alone.
PartnerShip.com/AUVSI
Enter 8075 in the promo code field
facebook/auvsi
instagram/auvsi
twitter/auvsi
AUVSI membership allows you to contribute to the unified voice of the unmanned
systems industry as we advocate for policies and regulations that encourage
industry growth and innovation.
Learn more at
auvsi.org/why-join-auvsi