Features
Features | ||||
---|---|---|---|---|
Auto-start | Device ID | QR Code Generation | Log In | Log Out |
Connection status | Location Status | Background Camera Operation | Device Visible on Dashboard | Device Status on Dashboard |
User-controlled Image Capture | Dashboard-controlled Image Capture | Image Frequency Control | Image Capture Type Control | Immediate Image Upload |
Announce Messaging | Announce Message Prioritisation | Historical Messages | Video Calling | SOS Alert |
Cancel SOS Alert | Man Down SOS | Local Storage Status | Local Storage Warning | Backlog Upload |
Privacy Mode | Ambient Noise Capture | Light & Dark UI Modes | Zone Definition | Zone Definition when Offline |
Features | ||||
---|---|---|---|---|
Device Management | MV Image Processing | Fire Extinguisher Detection | Hard Hat Detection | On Demand Snapshot |
Image Luminosity Check | Private Mode Timer | GeoSense Mapping | Zone Configuration | Alerts on Map |
Image Capture Control by Zone | Device Movement Reporting | Incident Reporting | Man Down Reporting | MV Capture Report |
Fire Extinguisher Location Report | Zone Duration Report | User Role Configuration | MS Team Video Call | Logic Automation – Missing Fire Extinguisher |
Logic Automation – Missing Fire Extinguisher | Logic Automation – High Risk Area | Logic Automation – Non-human Zone | Logic Automation – User Restricted Zone | Logic Automation – User SOS |
Evacuation & Muster Zoning | Zone Specific Announcements | User Specific Announcements | HSSE Dashboard |
Features | ||||
---|---|---|---|---|
XR Sense iOS | Logic Automation – Navigate to Location | UWB and BLE Implementation | Automation Logic – Escalate to Emergency Services | IoT Machinery Tracker |
Automation Logic – Machinery servicing | Dropped Object Risk Detection | Logic Automation – Dropped Object Mitigation | Broken Glass Detection | Logic Automation – Broken Glass Resolution |
Lighting without Safety Net Detection | Logic Automation – Lighting without Safety Net Resolution | Pump & Pipe Leak Detection | Logic Automation – Leak Resolution | Fire Detection |
Signage Detection | XR Sense (non-Realwear) |
XR Sense Android App
XR Sense is designed and developed to cover a wide range of devices. XR Sense picks data from its surrounding environment through multiple sensors including camera, voice, location, gyro, and thermal data which it then asynchronously sends the data to the Device Controller.
Event Processor
The Event Processor receives admin dashboard commands such as Announce Messaging or Zone Updates via the Event Listener. It also collects the sensory data from the App to share with the Device Controller and User Dashboard
API
The API shares the sensory array data collected from the App to the Device Controller and User Dashboard via the MQTT broker.
Event Listener
The Event Listener receives the Dashboard updates such as Zone Logic and Business Automation messages to maintain user efficiency whilst in environments.
In-app Recognition
The App’s updated GPS coordinates tracking updates the user’s current zone information in live time. App side logic enables
Local Store
Whilst the device has no internet connectivity, image capture and other sensory data logs are stored locally on the device until connectivity is reestablished. Zone Data is also stored offline to maintain user updates with active GPS coordinates.
Sensory Array
XR Sense collects Image, GPS, Thermal and Ambient noise data; that is shared with the Device Controller and User Dashboard for responsive automation logic or MV detection process.
Machine Vision Stack
MVS is a collection of several services that works together to extract outcome from captured images. It has access to real-time image feed and also the image repositories.
Faces | Situational detection model of head and face. Used in conjunction with the Hard Hat model. |
Hardhat | Situational detection model of hardhats. With Faces detection model, worker safety compliance is validated that they are being worn. |
Fire Extinguisher | Situational detection model of fire extinguisher and fire extinguisher boxes. |
PPE | Situational detection model of required PPE for operation when on-site in heavy industry. Includes the classification instances: Gloves, Goggles, High-visibility vests and work boots. |
Fire | Situational detection model of open fires present. |
Broken Glass | Situational detection model of a broken glass hazard |
Pipe Leaks | Situational detection model of rust and leaks from pipe fixtures. |
Dropped Objects & Dropped Object Risks | Situational detection model of Hanging lights, pipes, steelwork, masonry, ceilings. |
Site Signage | Situational detection model of signage displayed on-site and often viewed by personnel. Includes the classification instances: Guidance/Navigation signs or warning of risk to personnel wellbeing. |
Lamp without Safety Net | Situational detection model of lighting fixtures without protective housing. This includes mesh housing or netting. |
Image Processing Service
The Machine Vision Stack where images captured are processed in live-time.
MV Orchestrator
Images captured in real-time are shared to our detection models via API. Depending on Zone requirement of active automation logic specific models are requested to process individual images
Roboflow
content???
Short Term Storage
Images that have been recently processed and can be called upon easily for further analysis and review by Dashboard users or troubleshooting
Long Term Storage
Images that have been processed that has since been transferred to long-term storage for server optimisation. It can be retrieved at any time to short-term storage for review and analysis
Device Controller
The device Controller is a high-performance light-ware server used as a conduit for critical MQTT data transmission between the device and other systems of the XR Sense and client’s software ecosystem. The controller also serves as a developer dashboard for testing and debugging.
Web Frontend
Technical UI layout designed for ease of troubleshooting and diagnostics.
API
The API receives the sensory array data collected from the App to transmit to the User Dashboard via the MQTT broker.
Scheduler Dispatcher
The Scheduled dispatcher is designed to receive and send instructions generated from Business Logic to the application.
Event Processor
The Event Processor receives admin dashboard commands such as Announce Messaging or Zone Updates via the API. It also collects the sensory data from the App to share with the Image Processor and/or the User Dashboard
Image Processor
The Machine Vision Stack sub-system within the device controller where images captured are processed in live-time.
MQTT Broker
The MQTT server handles the data stream and further processes/routes to other systems. MQTT also assists in troubleshooting, communication recordings that can be used to identify issues and bottlenecks in your deployed IoT applications.
Event & Device Store
Device configurations and native device status such as the device battery level, connectivity status and current operation system for each device is stored here. This data is also shared and updated by the User Dashboard.
User Dashboard
The User Dashboard is A multi-tenant administrative backend and reporting platform custom built with simple integrations and scalability in mind.
Tenant/client management | User/Group Management |
Device Management & Remote device control | Zone management |
Event management | Triggers, notifications and communication |
Web Frontend
Business-led UI layout designed for ease of device management and data visualisation.
Logic Composer
Automation logic for zones, user activity and MV detection results are configured with desired outputs and automated response task generation for enhanced situational awareness and administration.
Report & Visualisation
XR Sense supports map based features (zone configuration, geo-fencing), live-time user location data, Alert, Events and Reporting visualisation.
API
The API receives the sensory array data collected from the App to transmit to the User Dashboard via the MQTT broker.
Business Logic Bus
The business logic bus uses captured information and triggers the app or admin instructions based on detected anomalies within the Machine Vision Stack, or parameters shared by the logic composer.
Scheduler Dispatcher
The Scheduled dispatcher is designed to receive and send instructions generated from Business Logic to the application.
Event Processor
The Event Processor shares admin dashboard commands such as Announce Messaging or Zone Updates via the API. It also collects the sensory data from the App and MV detection results from the device controller for processing by the logic composer.
Event Listener
The Event Listener shares and receives Dashboard updates such as Zone Logic and Business Automation messages to maintain user efficiency whilst in environments via the MQTT broker.
Queue
Triggered automation logic that is bound by timestamp are held by the queue as per the command of the logic composer via the business logic bus. The trigger is then fulfilled when the time elapses.
Tenant & Device Config Store
Device management configurations and native device status such as the device battery level, connectivity status and current operation system for each device is stored here. This data is also shared and updated by the User Dashboard. Device authentication and assigned site/zone information is also stored here.
Event Store
The Event store records historical alert and task items generated via the Dashboard or App for operational evidencing and reporting.
Short Term Storage
Data that have been recently processed and can be called upon easily for further analysis and review by Dashboard users or troubleshooting
Long Term Storage
Data that has been processed and that has since been transferred to long-term storage for server optimisation. It can be retrieved at any time to short-term storage for review and analysis and historical reporting.
IFTTT
If This Then That (IFTTT) enables the creation of highly configurable ‘applets’ with webhook integrations with the XR Sense platform. Events that occur in XR Sense triggers the defined response action set up in the IFTTT app.
IFTTT (Triggers IOT)
User created events or collected data that require escalation in conjunction with operational needs. For example, machine vision detection of missing apparatus or user activity updates.
Outputs
Announcements | Use SMTP, SMS, Text-to-speak or trigger VoiP calls to notify specified individuals and configure the periodicity in which updates are shared. |
Navigation | Navigate a user to the SOS coordination that comes from BE. It can open google maps and shows the direction to the SOS coordination + time, distance. |
Report Automation | Add raw data of events logged, with timestamps and other key parameters, to a spreadsheet and use later for analysis. |
Task Management | IFTTT can update Operational ‘To-Do lists’ tasks and messages in popular 3rd party project management tools such as Trello, Slack and Evernote. |
External Sensory Array | IFTTT can utilise sensory data received from Thermometers, Motion Sensors or Push buttons to trigger specified actions. |
Hardware Actions | Lighting, alarms and access controls that are IoT compatible can be managed based on configured triggers to specified actions. |
Business Tools | Manage a range of business tools and provide updates across departments with Mailchimp, Microsoft Teams, Zoom or Buffer integrations. |
Calendars & Scheduling | Manage date and time in a smarter manner. For example, tracking user activity hours logged within Google Calendar. |
Government / National News | Governmental news and work can be shared when connected. For example, get an email when a state or region issues a travel warning your site is within. |
Geographic Information Systems
XR Sense supports map based features (zone configuration, geo-fencing), live-time user Location Data, Alert, Events and Reporting visualisation.
Features
Maps | Add and visualise zoning logic. Create customised zone parameters. |
Geo-fencing | Turn coordinates into addresses or addresses into coordinates. |
Search | Turn any connected camera into an AI-powered Augmented Reality Fleet Management Tool. |
Vision | Add custom maps to web and mobile apps. |
Data | Add location datasets to any map, platform, or intelligence solution. |
Navigation | Live traffic, lane guidance, turn by turn navigation. |
Vectoring | Real-time styling, and interactivity features set the bar for anyone building fast, immersive maps on the web. |
Static Overlays | Place an image or UI overlay UIs where interactive maps can’t be displayed. |
Movement | Movement Data that gives you up-to-date insights about where people are moving most. |
Boundaries | Powers geospatial analysis and visualisations to derive valuable insights from any dataset. |