Microsoft-arkitekter demonstrerte Connected Field Service med IoT-varsler og HoloLens-basert fjernassistanse i Dynamics 365.
Dette opptaket fra 2019 er del 3 av 3 fra et arrangement i regi av ProsessPilotene og Microsoft Norge om Dynamics 365 Field Service. En arkitekt fra Microsofts Technology Center demonstrerte, sammen med kolleger, hvordan Connected Field Service kobler IoT-sensorer på maskiner til Dynamics: unormale utslag, som vibrasjon utenfor normalen, utløser automatisk et varsel som kan bli en sak og en arbeidsordre.
Løsningen viser alle IoT-varsler i et dashbord, og arbeidsordre kan tildeles teknikere basert på definerte ferdigheter, erfaring og geografisk nærhet. Det ble også vist toveiskommunikasjon med utstyret, blant annet muligheten til å sende en nødstoppkommando direkte fra Dynamics. Hele flyten fra varsel til sak, arbeidsordre og tildeling er konfigurerbar, slik at virksomheten selv definerer hvilke handlinger som skal utløses av ulike typer signaler.
I den andre delen av demonstrasjonen ble HoloLens-basert fjernassistanse vist frem: en tekniker i felt fikk håndfri, visuell veiledning fra en ekspert via Teams for å stanse og reparere en maskin med unormal vibrasjon, og skjermbilder fra økten ble lagret sammen med arbeidsordren som dokumentasjon.
Demonstrasjonen ble avsluttet med eksempler på bruksområder utenfor selve Field Service-scenarioet, som prediktivt vedlikehold basert på lydmønstre fra feilende motorer, planlegging i kraftbransjen, og et norsk sykehusprosjekt som brukte HoloLens til å planlegge hjertekirurgi på barn. Arrangørene inviterte også til et påfølgende frokostseminar om Dynamics 365 for salg, markedsføring og Power Apps.
we'll quickly go through the demo part
we're in with the help of Lars who is
our colleague working in the MDC
Microsoft Technology Center working
there as an architect who would assist
us with the with the demo and in in
these demos they will be talking about
to demo scenarios one would be the
connected field service wherein with the
help of this device we would see how
somebody in the field could interact
with any of these devices or any similar
devices and in the second part we will
do the inspection the remote assistance
where somebody in the field would need
Still et spørsmål eller del hva som hjalp deg.
some assistance in order to work on any
technical challenges so Before we jump
into that I'll quickly let large to do a
quick introduction
Janna Moscow Manickam horse - Rolla
elephant so some sucked minimal or she
wants an i/o bus um technically tacked
up was low empty Technology Center will
be surely deep anguish among a maverick
under or port salmon about a partner
third fourth ball Microsoft's platform
re can be dramatic cellular and digital
dice so we and elevate global programs
my enough a customer experience who
looks out dot Ascenta tours or
cybercrime unit Center from Holly
Redmond or Andhra industrial experience
centers run to me garden where Big Top
touch that Nene offering EU slow select
will be honest Dara
circuit an important it would be for
example can go deeper in a specialist in
Orion so there is thing to demonstrate
her I wouldn äôt a kombucha see Lori
summon word dynamics platform or special
to deny connected field service so mario
TI anthem censoring of machina or
devices things similar saw your protein
your in sector sumachs archive little
actions or be addre quadra-port earring
Minogue so through up until Izmir
effective operation of the devices so
they were Utah
I got rebuked up at ankles inaudible was
up in their license or a pond motor
click at maybe a starter narcissus
coming hard of Fida telemetry in the
azure IOT platform
anub arak a platformer you have Alex
Valadez McCullough for UTS in IO th
solution so maybe we can start him on
some errand Faraday applica whom through
coma gourmet you TIA
so has an aura table so hobby for
example definite top Donovan vitreous in
surah and the vibra shown and the
template to answer
you made it affected it till like those
who come here set up a diagonal for
example for the tech tiara for Shelley
anomaly ay-e-e-ah telemetry so as you
have a poor scroll aha I Sarah for
example an abnormal the vibration really
somehow definite from the clicker poor
vibration to condition succumb assay
aboard and there definite on the Vibrio
over and touch kill ready miron average
consists of a minute now so tell me we
are it still talk better than your
daughter autumn the clicker near a poem
if you scroll a bit I'm going to speak
English to my colleague you know in
origin so harsh a away for example
Microsoft closes may warp our platform
would and then broke us if you click on
that Microsoft flow
sukh and easier for example it wouldn't
be taught in a pail or the nasa dot dr.
Peck consumed us and at the UT a
platform an area there fairly and react
if you click on the new button the
harbor and demonstration who Ankita
enter new connecting throw and you Tia
central applica who kill in Dynamics CRM
the connected view service so if you
create from the template and you go you
will see that there is a a create
connected field service alert from an
IOT central so that's already built
solution if you would where you just
connect these two device or back-end
assure IOT which this one is talking to
you and of course you have a dynamics
365 tenant so this is how we connect
these two together so if we just close
this one and of course you can connect
our huddle or ski wodden I ignore
Florence Crittenton authentica
integrator men held on a platform sake
don't know again so this way if we go
back to the just for sure I think there
is a question here yeah
so underneath this IOT central
application is the IOT hub as the
infrastructure yeah yeah sure so the
question was see if we can use IOT hub
for this and yes this is just a software
solution we ready built the IOT central
but underneath there is the IOT hub
which is our full power iot platform so
in terms of this telemetry then we would
be able to go we would be able to see
the alerts
IOT alerts in the connected field
service portal so if we go back to the
dynamics you will see here here's the
dashboard from the connected field
service
so you will actually see all the
different alerts what type if you click
on one of these we will be able to go
into that payload I was talking about
what happened at what time what device
because potentially I have thousands of
devices of course connected through an
IOT central and it's not just about
monitoring and and looking and into your
data it's all about okay
all these insights if we connect one or
more sensors perhaps we that is a strong
signal that something needs to be happen
but there I here roll down here
you can see everything regarding the
alert and as you see there is this
standard process in the connected field
service I guess it's kind of
configurable yeah so you can configure
this in any ways but this is the
standard it's a alert raced a case is
created or a alert is created then you
can decide if it was a false positive or
a true alert you can create the case
create the work order and assign it to
someone to actually do some actions on
it so this is kind of the standard flow
that we're used to seeing in the in the
platform so it's a it's a perfect
combination of the scenarios where not
only from the IOT alerts the signals
what receiving dynamics but internally
manually or automatically we would be
able to create cases assign cases to any
technicians in the field or off the
field to work on any of those and all of
these action items in this case this
environment is out-of-the-box you have
the different sets of business processes
which you can define that if there is an
alert if there is any sort of signal
coming in what action needs to be taken
what do we need to create a case do we
need to assign it to a neck technician
how we are going to react to that we
could define all of it
in here in in in the same IOT alert
as you can see this dashboard is not
just the work flow very long and you can
feel technician it's also about the
devices so all the device is being
provisioned that one then shows up here
so you can actually do two-way
communication you can for instance
remotely do an emergency shutdown by by
just sending the command yeah by sending
commands you can also see all the work
orders the schedule board for the the
resources being assigned so you can
actually and this could of course be an
elaborate find the closest technician
with the correct kind of profile with
experience on this specific device with
an nearest location an assignment that
one so it's a it's a perfectly viable
use case for the connected field service
any question on this kind of part and
one aspect I would like to add from the
resource scheduling perspective is for
every technician we would have we could
have the skills defined saying if I am
an expert on dynamics someone else is an
expert on Azure that engineer who is
expert on Azure
would be picked up for that specific job
so you can define the skills you can
define the proficiency the SME factor
and all of it against any and every
engineer in working on any cases and
these kind of scenarios when they do
implement the IOT and this this is like
the industry for toll has shown a great
effect in terms of how to optimize
operations do predictive maintenance
instead of reactive maintenance saves
you millions potentially of dollars or
in a region code so it's it's it's a
very strong interest in this in the
market the next building on top of the
IOT is of course start using like the
digital twins where you create an even
richer environment connecting devices
and spaces and
in persons and applications and all of a
sudden you have a very much richer
picture of your complex be it industry
or whatever yeah yeah yeah okay so the
IOT hub which is down the line we
mentioned earlier is the kind of the
backbone of this solution and we have a
huge ecosystem with industry partners so
the major partners might already be in
under able to talk to this kind of
infrastructure and of course we're using
as much standard protocols as possible
so it's possible to connect any device
that is yeah emits signal so to speak
it's normal HTTP yes kind of things but
there's a huge this guy we we can talk
for hours regarding the IOT port and I
would love to do that but let's so now
we have the it's retreads now we have
kind of the schedule
I've been then assigned as the perfect
technician to do the actual or kind of I
was close by but I might not have the
right skill set but still I was
technician so then we're going to kick
off the next part of the demo which is
how we can utilize remote assist which
is it's not going to be a very remote
since we're standing
shoulder-to-shoulder potentially this
could be one guy in Oslo supporting a
technician in Thailand or wherever and
this has also shown a great effect time
to resolution has drastically come down
getting expert guidance in the field and
also the the level of correctness we
don't see much errors when you actually
have access to two experts so remote
assist good example not all the senior
engineers or willing to travel as much
as they did in the young days so that
you might send more less experienced
guys in the field so we're gonna see if
we can demo this and in the meantime
when we get this ready a quick overview
from the remote a suspect again
extending it from the usability
standpoint inspections are majorly used
for for the scenarios also if you have
any vendor companies who would like to
do these inspections and work for you
this could also be the scenarios for
them the first generation it was kind of
a prototype or indie platform to have
new kind of interfaces
the thing is heads up and hands-free is
a very strong thing when you're working
in the field so you don't need to have
one hand with your phone you can look at
the problem but still interact with so
this is the first generation there's a
second generation just around the corner
for lunch do much better in every sense
so that's a difference as well so what
we're gonna do here we're going to start
the remote the system this application I
can actually do this so the remote
assist is a separate application which
is connected to the the Field Service
and the dynamics platform but it's also
available in a in a mobile experience so
you don't need to buy this it's rather
expensive at the same time if you get
the resolution time down the business
case is quite strong doing good thank
you
okay so what I'm doing here is I'm just
creating a remote assist session so this
is using teams as you can see where it -
what you're seeing is Ritesh desktop so
what I'm trying to do is I'm trying to
pinpoint arrow it down that specific
location or the place I come to this
engine which has signaled some abnormal
vibration so I need to figure out how to
solve this
so Ritesh do you know this device yeah
yes I have worked on it yeah okay so
could you just guide me through the
process of stopping this and fixing it
sure if you could see there is a red
button if you could press that to stop
the machine first yeah now if you could
open the frame so that would be this
lever and oh yeah fall off is that there
is that blade yeah correct so this is to
be broken yeah mmhmm yeah it looks like
broken yeah let's try putting in the
another one but make sure that the one
which is written it should go inside
okay yeah so just replace this oh that's
the place yeah so you can see that
ritesh is able to draw on this and I
will also be able to if I can find him I
can also use documents I can bring up
she said and design documents or
whatever or draw but yeah so this is I
should have a hands hands-free switch
your hand and in the meantime when large
is doing that I'm also taking the
screenshots so solid I can attach it to
the document and keep it with me for
further inspections
it's actually taking it is crucial for
me as well so I can attach it to the
work order whatever yeah
whatever the inspection was regarding
and this could also help in any
documentation it's stating what was done
when the field technician was there in
the job trying to fix the problem
what exactly was covered under that
inspection thank you nurse yep
so there were nine killed mo continent
concept a la pintura from ik so having
been laying killer thing man-whore till
gong till all tingly in some type of
device I would truly become felt along
the upper mobile and on platform okay
it's personal any questions and any
scenarios you would like to to talk
about to discuss about based on what we
just went through anything on top of
your mind where you see any correlation
with your day to day job your business
you know challenges anything which you
could foresee you would like to talk
about something like that
[Music]
I don't think the first generation is of
course a bit rough on the edges still
very useful huge interest in the oil and
gas and health care they're doing it
actually to plan operations and
regarding the the gestures so I was
doing a kind of tapping in the air and
everything they're a bit awkward it
takes some time getting used to it like
five minutes the next generation is
going to be much richer it has a
stronger AI built in because it actually
has a computer than you're carrying a
computer on your head so it has all the
AI and more powerful sensors as well so
it's going to be much more I've tried it
on it's quite nice it's it's
windows-based it's a Windows OS which is
powering this off which now comes with
the AI infused capability in all the
operating systems along with other
Microsoft applications so if someone
would like to try it we have some like
holo humans and
design stuff as well if you want to try
it on and see how it works and they're
more questions any scenarios you could
think of let's say from the
transportation logistics commune a also
one of the the scenarios what I covered
was about the power grid let's say if
you have a hololens and there is this
guy who is climbing up the tower to fix
any problem and doesn't know what
exactly needs to be done this person
wearing the hololens would be able to
see you know on the cloud somewhere
hooking it up that scream that this is
what I'm supposed to do and just looking
at that screen that individual would be
able to work on that problem typical
senora's might be training it might be
iterative design is where can you
actually place be it in in a in a store
or whatever you can place and see how it
would appear on an augmented natural way
we have an example in the sea Kehoe's
wherein they are using the whole
Aquarius being yeah it's a Norwegian
project with the superest area together
with our jet seekers responsible just
this to plan child pediatric surgery on
hearts and other and there is other
there's a lot of interest but that's
just the hole and so I mean you know
folks here is the dynamics yeah but
whatever we could do with the hololens
we could get the information back into
the dynamics so it could be like when
you're doing these inspections whatever
inspections whatever issues you are
trying to fix all could be reported back
into dynamics which would have one
single repository of data which you
could use for any further predictive
analysis or let's say the machine
learning or anything so if you go back
to that I mean when you create the work
order you could of course then attach
all the relevant documents so the the
field technician have us access to
everything you know about
the location the device the engine or
the kind of issue any knowledgebase
articles whatever you have is which at
the end of the day helps them become
more productive and more efficient yeah
so for instance that could be in a more
richer environment you could actually
when you come to the this scene you
could have like overlays with the
digital twin and you can have I'm not
sure if I'm asking or answering your
question but you could have a much more
realistic overlay for instance and
anything from the dynamic since it's the
same kind of platform and it integrates
that you saw very easily with flow you
can have flows coming from the IOT
platform but of course you could have
flows or power-ups in the other
direction as well or or if you load from
this over to the work or if you would
like to explain any use case scenarios
what you have on top of your mind
let's say the LNG there is a pressure
which yeah
yeah yeah but perhaps that would be more
of the IOT hub and the intelligence that
you would provide edge we're talking
about edge intelligence I mean we would
sometimes you would like to provision
edge intelligence so it's small compute
intelligence on to the device sometimes
you want to be brought back into the
cloud that might be more of the IOT part
but of course dynamics plays plays role
but having them build like predictive
models on the known patterns we have
partners who has released data sets of
sounds of faulty engines Hitachi so you
can just build AI models so when there's
the squeaking sound of this character
what might it indicate there's a lot of
available that's kind of them we can
empower anyone to do kind of everything
today
[Music]
there's no daddy harveyi diffs dog was
Jesse behind on a bargain would a son
share a lot public applause order
sharing the share thing the combined egg
discovery to settle on smallest so
Highlander entrepreneur none the
hide-and-clap documentary'
and Lincoln may build or motor
consequence identity thing then
commencement shock some big Highland
bounded and Lucian relational and Damien
also called our telethon signature it's
not a billion female quotient
illumination while driving out there
fraud a big action star of tank emblem
you know okay boss here podía so Villa
for Davi thinking tempest Amidala
commenting spending a Gaussian Terry
care that Munford hot and puppy mellow
dimensionally openness Telugu seminars
miss Connell member jose kavi visa from
they also offer and conduct at the
highest row across the psalmist nigel
any further questions okay if not i
would like to make one more request that
next week on 23rd of october we are
running a symposium on dynamics 365
sales marketing and power apps which
would be again almost the same timing
like the breakfast seminar kind of where
and we will touch upon these other
aspects of the dynamics 365 as well
so whoever would like to join us please
be free go to the Microsoft events page
and register for the event
thank you very much
[Applause]
doubling on VA also mean um chuckles I'm
annoyed nest
throw some night so I should first
November some filters no mr. Daley give
it nor poor Eventbrite so about going on
Saturday that I own their own IT
governance top pros
[Applause]
Prosjektledelse | Konferanse
DynUG samlet fagmiljøene rundt Dynamics 365, Power Platform og Fabric i Oslo.
Kunstig intelligens | Webinar
Frode Stenstrøm og Adrian Sjøholt testet Google, OpenAI og Anthropic i praktisk prosjektplanlegging, fra kravdokument til presentasjon.
Innsikt og analyse | Webinar
Yuliia Kamkova viste Frode Stenstrøm hvordan Power BI kan hente data fra Dynamics 365 Project Operations og bygges tilbake inn i CRM.
Prosjektledelse | Webinar
Terje Melheim og Ida Langdalen Kristiansen fra Moelven fortalte Frode Stenstrøm om aktivt lederskap og intern kommunikasjon i konsernet.

Kunstig intelligens | Artikkel
OpenAIs Data agent kunne undersøke virksomhetsdata og bygge delbare interaktive dashbord. Tilgangskontroller og kildespor måtte følge analyse og handling gjennom arbeidsflyten.

Kundeservice | Artikkel
WEM MCP-verktøy åpnet for fraværsforespørsler, skiftbytter og skiftbud i Service Agent. Administratorer kunne aktivere hvert verktøy for rolle, team eller pilotgruppe.

Automatisering | Artikkel
Power BI-rapporter og semantiske modeller ble tilgjengelige som grunnlag i Copilot Chat og Cowork. Delte chatøkter, synkroniserte notatbøker og Planner-status knyttet analyse til samarbeid.

Automatisering | Artikkel
Microsoft erstattet halvårlige release waves med løpende veikartpublisering. Kundeprosesser måtte følge status fra utvikling til utrulling og lansering.

Prosjektledelse | Artikkel
Copilot Notebooks og Cowork fikk flere måter å dele prosjektkontekst på. Agentmålinger og kostnadskontroll ble bygget ut i administrasjonssenteret.

Kundeservice | Artikkel
Sales og Service Agent ble generelt tilgjengelige i Microsoft 365 Copilot. Dynamics beskrev MCP-handlinger på tvers av salg, service, felt og prosjekter.
Del et spørsmål eller en refleksjon.
Bli den første som bidrar.