Search Results

Improving passenger safety inside vehicle cabins requires continuously monitoring vehicle seat occupancy statuses. Monitoring a vehicle seat’s occupancy status includes detecting if the seat is occupied and classifying the seat’s occupancy type. This paper introduces an innovative non-intrusive technique that employs capacitive sensing and an occupancy classifier to monitor a vehicle seat’s occupancy status. Capacitive sensing is facilitated by a meticulously constructed capacitance-sensing mat that easily integrates with any vehicle seat. When a passenger or an inanimate object occupies a vehicle seat equipped with the mat, they will induce variations in the mat’s internal capacitances. The variations are, in turn, represented pictorially as grayscale capacitance-sensing images (CSI), which yield the feature vectors the classifier requires to classify the seat’s occupancy type.

Autonomous vehicles (AV) are sophisticated systems comprising various sensors, powerful processors, and complex data processing algorithms that navigate autonomously to their respective goals. Out of several functions performed by an AV, one of the most important is developing situational intelligence to predict collision-free future trajectories. As an AV operates in environments consisting of various entities, such as other AVs, human-driven vehicles, and static obstacles, developing situational intelligence will require a collaborative approach. The recent developments in artificial intelligence (AI) and deep learning (DL) relating to AVs have shown that DL-based models can take advantage of information sharing and collaboration to develop such intelligence.

Passenger comfort is a critical factor in user acceptance of autonomous vehicles (AVs). Despite existing methods for passenger comfort assessment, new approaches to assessing passenger comfort in AVs may be valuable to the automotive industry. In this paper, continuous pressing-based and discrete smartphone-based approaches for comfort assessment were designed and implemented in a user study. Participants used the two approaches to evaluate their comfort levels in an experimental study based on a high-fidelity autonomous driving simulator. Performances of the two approaches in assessing comfort levels were analyzed and compared. In general, the discrete approach showed better measurement repeatability and lower measurement bias than the continuous approach. The performance gap of the continuous approach could be reduced with proper post-processing measures. Discussions on the potential uses of the approaches were also raised.

Autonomous vehicles have the potential to transform lives by providing transportation to a wider range of users. However, with this new method of transportation, user acceptance and comfort are critical for widespread adoption. This exploratory study aims to investigate what makes passengers uncomfortable in existing vehicles to inform the design of future autonomous vehicles. In order to predict what may impact user acceptance for a diverse rider population for future autonomous vehicles, it is important to understand what makes a broad range of passengers uncomfortable today. In this study, interviews were conducted for a total of 75 participants from three diverse groups, including 20 automotive engineering graduate students who are building an autonomous concept vehicle, 21 non-technical adults, and 34 senior citizens. The results revealed both topics which made different groups of passengers uncomfortable as well as how these varied between the groups.

Fully autonomous vehicles have the potential to fundamentally transform the future transportation system. While previous research has examined individuals’ perceptions towards fully autonomous vehicles, a complete understanding of attitudes and opinions across the lifespan is unknown. Therefore, individuals’ awareness, acceptance, and preferences towards autonomous vehicles were obtained from 75 participants through interviews with three diverse groups of participants: 20 automotive engineering graduate students who were building an autonomous concept vehicle, 21 non-technical adults, and 34 senior citizens. The results showed that regardless of age, an individual’s readiness to ride in a fully autonomous vehicle and the vehicle’s requirements were influenced by the users’ understanding of autonomous vehicles.

Collaborative robots are more and more used in smart manufacturing because of their capability to work beside and collaborate with human workers. With the deployment of these robots, manufacturing tasks are more inclined to be accomplished by multiple humans and multiple robots (MH-MR) through teaming effort. In such MH-MR collaboration scenarios, the task distribution among the multiple humans and multiple robots is very critical to efficiency. It is also more challenging due to the heterogeneity of different agents. Existing approaches in task distribution among multiple agents mostly consider humans with assumed or known capabilities. However human capabilities are always changing due to various factors, which may lead to suboptimal efficiency. Although some researches have studied several human factors in manufacturing and applied them to adjust the robot task and behaviors.

This paper presents an approach for performing software in the loop testing of autonomous vehicle software developed in the Autoware framework. Autoware is an open source software for autonomous driving that includes modules such as localization, detection, prediction, planning and control [8]. Multitudes of autonomous driving frameworks exist today, each having its own pros and cons. Often, MATLAB-Simulink is used for rapid prototyping, system modeling and testing, specifically for the lower-level vehicle dynamics and powertrain control features. For the autonomous software, the Robotic Operating System (ROS) is more commonly used for integrating distributed software components so that they can easily share information through a publish and subscribe paradigm. Thorough testing and evaluation of such complex, distributed software, implemented on a physical vehicle poses significant challenges in terms of safety, time, and cost, especially when considering rare edge cases.

In this paper, we present a framework for the robot to learn how to place objects to a workpiece by learning from humans in smart manufacturing. In the proposed framework, the rational scene dictionary (RSD) corresponding to the keyframes of task (KFT) are used to identify the general object-action-location relationships. The Generalized Voronoi Diagrams (GVD) based contour is used to determine the relative position and orientation between the object and the corresponding workpiece at the final state. In the learning phase, we keep tracking the image segments in the human demonstration. For the moment when a spatial relation of some segments are changed in a discontinuous way, the state changes are recorded by the RSD. KFT is abstracted after traversing and searching in RSD, while the relative position and orientation of the object and the corresponding mount are presented by GVD-based contours for the keyframes.

It’s important to predict human actions in the industry assembly process. Foreseeing future actions before they happened is an essential part for flexible human-robot collaboration and crucial to safety issues. Vision-based human action prediction from videos provides intuitive and adequate knowledge for many complex applications. This problem can be interpreted as deducing the next action of people from a short video clip. The history information needs to be considered to learn these relations among time steps for predicting the future steps. However, it is difficult to extract the history information and use it to infer the future situation with traditional methods. In this scenario, a model is needed to handle the spatial and temporal details stored in the past human motions and construct the future action based on limited accessible human demonstrations.

In recent times, a number of reference implementations of Simultaneous Localization and Mapping (SLAM) and navigation techniques have been made publicly available via the ROS Community. Several implementations have transitioned to commercial products (vacuum robots, drones, warehouse robots, etc.). However, in such cases, they are specialized and optimized for their specific domains of deployment. In particular, their success criteria have been based primarily on mission completion and safety of humans around them. In this light, deployment in any new operational design domain (ODD) requires at least a careful verification of performance and often re-optimization. We seek the technological gaps that need to be addressed to ensure the mobile robots are fit for automotive manufacturing environments. Automotive final assembly environments pose significant additional challenges for mobile robot deployment.

Capacitance sensing is the technology that detects the presence of nearby objects by measuring the change in capacitance. A change in capacitance is triggered either by a change in dielectric constant, area of overlap or distance of separation between the electrodes of the capacitor. It is a technology that finds wide use in applications such as touch screens, proximity sensing etc. Drawing motivation from such applications, this paper investigates how capacitive sensing can be employed to detect the presence and posture of occupants inside vehicles. Compared to existing solutions, the proposed approach is low-cost, easy to deploy and highly efficient. The sensing system consists of a capacitance-sensing mat that is embedded with copper foils and an associated sensing circuitry. Inside the mat the foils are arranged in rows and columns to form several touch-nodes across the surface of the mat.

Human steering intervention is an important factor for the safety and control performance of autonomous vehicles. Accurate identification of human steering torque will enable human drivers to take over the controls from the autonomous driving system whenever they require or intend to. However, in the take-over process, both the human driver and actuator motor will apply active torques simultaneously on the steering wheel, thus the human torque cannot be detected by using a torque sensor due to the coupled torques. Therefore, effective estimation though the system dynamics can be an alternative measure to achieve the detection and a comparatively accurate quantification of the human steering intervention torque. In this paper, an online estimation strategy of human steering intervention torque for the steering actuation system of an autonomous vehicle is presented. The dynamic model of the steering actuation system is firstly established.

Learning only from a small set of examples remains a huge challenge in machine learning. Despite recent breakthroughs in the applications of neural networks, the applicability of these techniques has been limited by the requirement for large amounts of training data. What’s more, the standard supervised machine learning method does not provide a satisfactory solution for learning new concepts from little data. However, the ability to learn enough information from few samples has been demonstrated in humans. This suggests that humans may make use of prior knowledge of a previously learned model when learning new ones on a small amount of training examples. In the area of autonomous driving, the model learns to drive the vehicle with training data from humans, and most machine learning based control algorithms require training on very large datasets. Collecting and constructing training data set takes a huge amount of time and needs specific knowledge to gather relevant information.

Autonomous driving technologies can provide better safety, comfort and efficiency for future transportation systems. Most research in this area has mainly been focused on developing sensing and control approaches to achieve various autonomous driving functions. Very little of this research, however, has studied how to efficiently handle sensing exceptions. A simple exception measured by any of the sensors may lead to failures in autonomous driving functions. The autonomous vehicles are then supposed to be sent back to manufacturers for repair, which takes both time and money. This paper introduces an efficient approach to make human drivers able to online teach autonomous vehicles to drive under sensing exceptions. A human-vehicle teaching-and-learning framework for autonomous driving is proposed and the human teaching and vehicle learning processes for handling sensing exceptions in autonomous vehicles are designed in detail.