XR SENSE ARCHITECTURE

Features

Features
Auto-start Device ID QR Code Generation Log In Log Out
Connection status Location Status Background Camera Operation Device Visible on Dashboard Device Status on Dashboard
User-controlled Image Capture Dashboard-controlled Image Capture Image Frequency Control Image Capture Type Control Immediate Image Upload
Announce Messaging Announce Message Prioritisation Historical Messages Video Calling SOS Alert
Cancel SOS Alert Man Down SOS Local Storage Status Local Storage Warning Backlog Upload
Privacy Mode Ambient Noise Capture Light & Dark UI Modes Zone Definition Zone Definition when Offline
Features
Device Management MV Image Processing Fire Extinguisher Detection Hard Hat Detection On Demand Snapshot
Image Luminosity Check Private Mode Timer GeoSense Mapping Zone Configuration Alerts on Map
Image Capture Control by Zone Device Movement Reporting Incident Reporting Man Down Reporting MV Capture Report
Fire Extinguisher Location Report Zone Duration Report User Role Configuration MS Team Video Call Logic Automation – Missing Fire Extinguisher
Logic Automation – Missing Fire Extinguisher Logic Automation – High Risk Area Logic Automation – Non-human Zone Logic Automation – User Restricted Zone Logic Automation – User SOS
Evacuation & Muster Zoning Zone Specific Announcements User Specific Announcements HSSE Dashboard
Features
XR Sense iOS Logic Automation – Navigate to Location UWB and BLE Implementation Automation Logic – Escalate to Emergency Services IoT Machinery Tracker
Automation Logic – Machinery servicing Dropped Object Risk Detection Logic Automation – Dropped Object Mitigation Broken Glass Detection Logic Automation – Broken Glass Resolution
Lighting without Safety Net Detection Logic Automation – Lighting without Safety Net Resolution Pump & Pipe Leak Detection Logic Automation – Leak Resolution Fire Detection
Signage Detection XR Sense (non-Realwear)

XR Sense Android App

XR Sense is designed and developed to cover a wide range of devices. XR Sense picks data from its surrounding environment through multiple sensors including camera, voice, location, gyro, and thermal data which it then asynchronously sends the data to the Device Controller.

Event Processor

The Event Processor receives admin dashboard commands such as Announce Messaging or Zone Updates via the Event Listener. It also collects the sensory data from the App to share with the Device Controller and User Dashboard

API

The API shares the sensory array data collected from the App to the Device Controller and User Dashboard via the MQTT broker.

Event Listener

The Event Listener receives the Dashboard updates such as Zone Logic and Business Automation messages to maintain user efficiency whilst in environments.

In-app Recognition

The App’s updated GPS coordinates tracking updates the user’s current zone information in live time. App side logic enables

Local Store

Whilst the device has no internet connectivity, image capture and other sensory data logs are stored locally on the device until connectivity is reestablished. Zone Data is also stored offline to maintain user updates with active GPS coordinates.

Sensory Array

XR Sense collects Image, GPS, Thermal and Ambient noise data; that is shared with the Device Controller and User Dashboard for responsive automation logic or MV detection process.

Machine Vision Stack

MVS is a collection of several services that works together to extract outcome from captured images. It has access to real-time image feed and also the image repositories.

Faces Situational detection model of head and face. Used in conjunction with the Hard Hat model.
Hardhat Situational detection model of hardhats. With Faces detection model, worker safety compliance is validated that they are being worn.
Fire Extinguisher Situational detection model of fire extinguisher and fire extinguisher boxes.
PPE Situational detection model of required PPE for operation when on-site in heavy industry. Includes the classification instances: Gloves, Goggles, High-visibility vests and work boots.
Fire Situational detection model of open fires present.
Broken Glass Situational detection model of a broken glass hazard
Pipe Leaks Situational detection model of rust and leaks from pipe fixtures.
Dropped Objects & Dropped Object Risks Situational detection model of Hanging lights, pipes, steelwork, masonry, ceilings.
Site Signage Situational detection model of signage displayed on-site and often viewed by personnel. Includes the classification instances: Guidance/Navigation signs or warning of risk to personnel wellbeing.
Lamp without Safety Net Situational detection model of lighting fixtures without protective housing. This includes mesh housing or netting.

Image Processing Service

The Machine Vision Stack where images captured are processed in live-time.

MV Orchestrator

Images captured in real-time are shared to our detection models via API. Depending on Zone requirement of active automation logic specific models are requested to process individual images

Roboflow

content???

Short Term Storage

Images that have been recently processed and can be called upon easily for further analysis and review by Dashboard users or troubleshooting

Long Term Storage

Images that have been processed that has since been transferred to long-term storage for server optimisation. It can be retrieved at any time to short-term storage for review and analysis

Device Controller

The device Controller is a high-performance light-ware server used as a conduit for critical MQTT data transmission between the device and other systems of the XR Sense and client’s software ecosystem. The controller also serves as a developer dashboard for testing and debugging.

Web Frontend

Technical UI layout designed for ease of troubleshooting and diagnostics.

API

The API receives the sensory array data collected from the App to transmit to the User Dashboard via the MQTT broker.

Scheduler Dispatcher

The Scheduled dispatcher is designed to receive and send instructions generated from Business Logic to the application.

Event Processor

The Event Processor receives admin dashboard commands such as Announce Messaging or Zone Updates via the API. It also collects the sensory data from the App to share with the Image Processor and/or the User Dashboard

Image Processor

The Machine Vision Stack sub-system within the device controller where images captured are processed in live-time.

MQTT Broker

The MQTT server handles the data stream and further processes/routes to other systems. MQTT also assists in troubleshooting, communication recordings that can be used to identify issues and bottlenecks in your deployed IoT applications.

Event & Device Store

Device configurations and native device status such as the device battery level, connectivity status and current operation system for each device is stored here. This data is also shared and updated by the User Dashboard.

User Dashboard

The User Dashboard is A multi-tenant administrative backend and reporting platform custom built with simple integrations and scalability in mind.

Tenant/client management User/Group Management
Device Management & Remote device control Zone management
Event management Triggers, notifications and communication

Web Frontend

Business-led UI layout designed for ease of device management and data visualisation.

Logic Composer

Automation logic for zones, user activity and MV detection results are configured with desired outputs and automated response task generation for enhanced situational awareness and administration.

Report & Visualisation

XR Sense supports map based features (zone configuration, geo-fencing), live-time user location data, Alert, Events and Reporting visualisation.

API

The API receives the sensory array data collected from the App to transmit to the User Dashboard via the MQTT broker.

Business Logic Bus

The business logic bus uses captured information and triggers the app or admin instructions based on detected anomalies within the Machine Vision Stack, or parameters shared by the logic composer.

Scheduler Dispatcher

The Scheduled dispatcher is designed to receive and send instructions generated from Business Logic to the application.

Event Processor

The Event Processor shares admin dashboard commands such as Announce Messaging or Zone Updates via the API. It also collects the sensory data from the App and MV detection results from the device controller for processing by the logic composer.

Event Listener

The Event Listener shares and receives Dashboard updates such as Zone Logic and Business Automation messages to maintain user efficiency whilst in environments via the MQTT broker.

Queue

Triggered automation logic that is bound by timestamp are held by the queue as per the command of the logic composer via the business logic bus. The trigger is then fulfilled when the time elapses.

Tenant & Device Config Store

Device management configurations and native device status such as the device battery level, connectivity status and current operation system for each device is stored here. This data is also shared and updated by the User Dashboard. Device authentication and assigned site/zone information is also stored here.

Event Store

The Event store records historical alert and task items generated via the Dashboard or App for operational evidencing and reporting.

Short Term Storage

Data that have been recently processed and can be called upon easily for further analysis and review by Dashboard users or troubleshooting

Long Term Storage

Data that has been processed and that has since been transferred to long-term storage for server optimisation. It can be retrieved at any time to short-term storage for review and analysis and historical reporting.

IFTTT

If This Then That (IFTTT) enables the creation of highly configurable ‘applets’ with webhook integrations with the XR Sense platform. Events that occur in XR Sense triggers the defined response action set up in the IFTTT app.

IFTTT (Triggers IOT)

User created events or collected data that require escalation in conjunction with operational needs. For example, machine vision detection of missing apparatus or user activity updates.

Outputs

Announcements Use SMTP, SMS, Text-to-speak or trigger VoiP calls to notify specified individuals and configure the periodicity in which updates are shared.
Navigation Navigate a user to the SOS coordination that comes from BE. It can open google maps and shows the direction to the SOS coordination + time, distance.
Report Automation Add raw data of events logged, with timestamps and other key parameters, to a spreadsheet and use later for analysis.
Task Management IFTTT can update Operational ‘To-Do lists’ tasks and messages in popular 3rd party project management tools such as Trello, Slack and Evernote.
External Sensory Array IFTTT can utilise sensory data received from Thermometers, Motion Sensors or Push buttons to trigger specified actions.
Hardware Actions Lighting, alarms and access controls that are IoT compatible can be managed based on configured triggers to specified actions.
Business Tools Manage a range of business tools and provide updates across departments with Mailchimp, Microsoft Teams, Zoom or Buffer integrations.
Calendars & Scheduling Manage date and time in a smarter manner. For example, tracking user activity hours logged within Google Calendar.
Government / National News Governmental news and work can be shared when connected. For example, get an email when a state or region issues a travel warning your site is within.

Geographic Information Systems

XR Sense supports map based features (zone configuration, geo-fencing), live-time user Location Data, Alert, Events and Reporting visualisation.

Features

Maps Add and visualise zoning logic. Create customised zone parameters.
Geo-fencing Turn coordinates into addresses or addresses into coordinates.
Search Turn any connected camera into an AI-powered Augmented Reality Fleet Management Tool.
Vision Add custom maps to web and mobile apps.
Data Add location datasets to any map, platform, or intelligence solution.
Navigation Live traffic, lane guidance, turn by turn navigation.
Vectoring Real-time styling, and interactivity features set the bar for anyone building fast, immersive maps on the web.
Static Overlays Place an image or UI overlay UIs where interactive maps can’t be displayed.
Movement Movement Data that gives you up-to-date insights about where people are moving most.
Boundaries Powers geospatial analysis and visualisations to derive valuable insights from any dataset.
This website uses cookies to improve your experience. We'll assume you're ok with this, but you can opt-out if you wish.
ACCEPT
This website uses cookies to improve your experience. We'll assume you're ok with this, but you can opt-out if you wish.
ACCEPT