ROBOY STUDENT TEAM · WAITER Feb, 2022 ROBOY THE CARPENTER Feb, 2024 MARS ... Roboy Project Roboy &...
Transcript of ROBOY STUDENT TEAM · WAITER Feb, 2022 ROBOY THE CARPENTER Feb, 2024 MARS ... Roboy Project Roboy &...
ROBOY.ORG
ROBOY STUDENT TEAMmastering technical correctness
24.01.2018IntroductionRafael Hostettler
Roboy-made Lighthouse Sensor60Hz, 1mm accuracy, external object tracking
ROBOY.ORG
ROBOY.ORG
ROBOY.ORG
ROBOY.ORG
ROBOY.ORG
ROBOY.ORG
OUR VISION
* Comparable dexterity, sensor acuity,
softness, flexibility, strength and
ability to self-repair
a robot as good as the human body
ROBOY.ORG
THE BEGINNING OF THE STORY
ECCE Design Study, 2011Cronos, 2007
robots like the human body
ROBOY.ORG
A STEP TOWARDS ROBOY
ECCEROBOT Project
from art to engineering
ROBOY.ORG
ROBOY JUNIORthe first of its kind
ROBOY.ORG
ACHIEVING THE VISION
TUM’s BEST STUDENTS guided by PhDs IN ROBOTICS
ELECTRICALENGINEERING
MECHANICALENGINEERING
ROBOTICSCOMPUTERSCIENCE
ECONOMICS
by creating a magical team
ROBOY.ORG
build
break
learn
ACHIEVING THE VISIONthrough research
ROBOY.ORG
Control
Mechatronics Middleware
Cognition
Building the bodyof Roboy 2.0
Roboy’snervous system &tracking
Making Roboyintelligent
Making Roboymove, walk, reach
ROBOY’S GUILDScompetency clustered
ROBOY.ORG
WHERE WE COME FROMgetting better at getting things done
ROBOY.ORG
MECHATRONICSwhat makes robots robots
ROBOY.ORG
ROBOTS BUILT ALONG THE WAYparts of humanoids
ROBOY.ORG
ROBOY 2.0
300N Muscle
the second generation
ROBOY.ORG
ROBOY 2.0
300N Muscle
the second generation
ROBOY.ORG
MIDDLEWARE
MAGIC
Hardware
Software
the spark of life
ROBOY.ORG
POWERFUL MIDDLEWAREfast, versatile, magical
ROBOY.ORG
LIGHTHOUSE TRACKINGvirtual reality repurposed
ROBOY.ORG
SENSINGmaking roboy feel itself
ROBOY.ORG
CONTROLactually doing stuff
ROBOY.ORG
MATH CONTROLdoing stuff provably
ROBOY.ORG
DEP CONTROLself exploring networks
ROBOY.ORG
HILL-MUSCLE CONTROL
26
Myorobotics
Muscle Experiments
making muscles real
ROBOY.ORG
COGNITIONcogito ergo sum
ROBOY.ORG
VISION
• DLIB: Facial landmarks and face recognition
• Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks
• You Only Look Once: Unified, Real-Time Object Detection
• FaceNet: A Unified Embedding for Face Recognition and Clustering
I see you
ROBOY.ORG
DIALOG MANAGER
● Sequence to Sequence Learning with Neural Networks for answer generation
● Skip-Thoughts Vectors based intent classification
● DBpedia as structured information source
• Rule-based• DBpedia ontology• Generative model
look at that b*tch boy
ROBOY.ORG
MEMORYgreat to see you, again!
ROBOY.ORG
SIMULATION & VRmuch less painfull
ROBOY.ORG
INTERACTIVE VR SIMULATIONbe roboy – the preview
ROBOY.ORG
SMOOTH WORK FLOW
Robot LibraryCAD
Muscle Plugin
design, simulate, build, repeat
ROBOY.ORG
HUMAN BRAIN PROJECT
Server-Based Simulation:Artificial brains control biomimetic robots
Brain Physics Muscles
artificial creatures, step 1
ROBOY.ORG
GAMESit’s fun to play
ROBOY.ORG
WHERE WE ARE NOWand what you’ll be working on
2018
2019
2020
Mar, 2018
ROBOY 2.0
Aug, 2019
ROBOY SELLSICE CREAM
Feb, 2019
ROBOYRIKSCHA
Aug, 2018
ROBOY DJ
Oct, 2018 – Oct. 2019
DEUTSCHLANDJAHR
ROBOY.ORG
WHERE WE WILL BEthe sky is not the limit
2017
2018
2013 2015 2016
April, 2016
ROBOY JOINSHUMAN BRAIN
PROJECT
From Roboy to Modular Toolkit
September, 2015
ROBOY TEAM FOUNDATION
Roboy on Tour
2019
2020
2021
2024
Twice per YearHACK ROBOY HACKATHON
AnuallyROBOY TEAM TRIP
2022
2023
March, 9, 2013
BIRTH OF ROBOY Mar, 2018
ROBOY 2.0
Oct, 2018 – Oct. 2019
DEUTSCHLANDJAHR
Aug, 2020
DR. ROBOY
Feb, 2021
ROBOY THEWAITER
Feb, 2022
ROBOY THECARPENTER
Feb, 2024
MARSROBOY
Feb, 2023
ROBOY BUILDSROBOY
Feb, 2020
ROBOY THECHEF
Aug, 2019
ROBOY SELLSICE CREAM
Feb, 2019
ROBOYRIKSCHA
Aug, 2018
ROBOY DJ
ROBOY.ORG
BUILDING IS NOT ENOUGHit’s an initiative that transforms society
Roboy Project
Roboy & Lucy
Roboy Initative
SponsoringCollaborationsFairsEventsRoboy at School
BE FRIENDLY.
THE CORE PRINCIPLE OF TECHIES & ETHICS
BY ROBOY & LUCY.
ROBOY.ORG
ROBOY’S SPONSORSmaterials to make robots real
ROBOY.ORG
FAIRSshowing off roboy to the world
ROBOY.ORG
• Electro Active Polymers
• Silicones
TOPICS
- Building control electronics for EAPs
- EAP testing setup
- LightSkin – silicone skin
- ElectricSkin – EAP based skin
ROBOY.ORG
• Project Soli
• MEMS Microphones
• Integrated BLDC Drivers
TOPICS
- Motor driver board testing & integration
- Sound-based motor localisation
- Speaker tracking
ROBOY.ORG
HUMAN BRAIN PROJECTproviding bodies for simulated brains
ROBOY.ORG
RESEARCH COLLABORATIONS
And many more: ETH Zurich, EPFL, KTH, IIT, Disney Research, Stanford, CMU, MIT, Harvard, KIT, Aldebaran, Poitiers, JSK, ...
making science happen
ROBOY.ORG
RESEARCH TRAVELcollaborate, travel and having fun
ROBOY.ORG
HIGH PROFILE EVENTS
javascript:;
explaining robotics to executives
ROBOY.ORG
• §
ROBOY AT SCHOOLigniting the young ones
ROBOY.ORG
www.roboy.org
ROBOY.ORG
www.roboy.org
www.roboy.org/lucy
ROBOY.ORG
www.roboy.org
www.roboy.org/lucy
MULTIMEDIA
Virtual & Augmented / Mixed Reality
Learning Experiences
MERCHANDISING
Children‘s books& Hardware (Roboy Kit,
Mr. Big, Checker...)
VIDEOS
Tutorials & Stories of and
with R&L
EVENTS
Mobile Exhibition & Interactive Experiences
ROBOY & LUCYroboy.org/lucy
CODING
Makeathons & Hackathons –Build and programRoboys
EXHIBITIONS
Roboy & R&L –History and OutlookRoboy 2.0
MULTIPLIERS
Teacher education on AI & Ethics, Digitalisation
© ROBOY & LUCY, Mai 2017 www.roboy.org/Lucy
ROBOY.ORG
SHUT UP AND TAKE MY TIME
• WANT TO BE PART OF ALL OF THIS?
how to become a roboyan
ROBOY.ORG
Positions (€)
• Team Orga
• Marketing
• Sales / Key Account Management
• Art & Design Orga
• Roboy & Lucy
• Writing Proposals
ECTS – Roboy Student Team
• Lab Course (IN, RCI)
• Seminar (IN, RCI)
• Forschungspraxis (EE)
• Project Studies (BWL)
• Thesis (MEng)
• Thesis (rest, 4 slots)
• IDP (IN, limited)
POSITIONS & CREDITS
❤️
how to help roboy
& Experience
• Roboy Angel
ROBOY.ORG
ROBOY AS SEMINAR
• Scrum Master (max. 3) – 2 teams each
– Very organised people only
• Build our Knowledge Library
– Start from 5 papers, find 50, summarize 15
• Channel Master (max. 5)
– Curate our robot tech channel
• Interested? Write to: [email protected]
special credits for special people
ROBOY.ORG
TECH TEAM ORGANISATION
• Team of four, possibly from different Guilds
• Team is associated with Guild Master & Scrum Master
• Meet weekly w. Guild Master
• Scrum Master
– Scrum Master as Seminar – [email protected]
• Monthly Social Events
– Organisation is taking turns
• Shirts ;)
how you will work
ROBOY.ORG
OUR TOOLSbringing order into chaos
Access & Courses
ROBOY ROOM
ROBOY.ORG
• Selfdriving Rikscha
• Roboy Rikscha Driver
• Lighthouse tracking
• PabiLegs Challenge
• VR Assembly Aid
• Hand Guesture Control
• DART Tracker
• End-to-end dialog system using generative neural networks
• General-purpose semantic question answering
• On-the-fly face recognition
• Speaker recognition
• Audio-based sentiment analysis
• Speech Synthesis with GANs
POSSIBLE TEAMS (excerpt)
Will be extended on www.roboy.org/joinby 1.3.2018
ROBOY.ORG
WHAT WE WORK WITH
ROBOY.ORG
PREREQUIREMENTS
One of:
• Object Oriented Programming (C++, Python)
• ROS
• Gazebo
• Unity
• CAD (Autodesk Fusion360)
+ Linux
• We will do workshops in: ROS, GIT
every roboticists should know…
ROBOY.ORG
GRADING
Sym Item Description Mark Weight
Q Work quality Assessment of the quality of the project solution (in
terms of usability, originality). 60% w. D
D Documentation Code/project documentation quality on Confluence. 60% w. Q
W Weekly report Complete a brief weekly report (on Confluence),
checked by scrum master. 10%
B Blog about your work Writing about your work in a blog post 5%
P1,
P2
Presentation quality Mid-term and final presentations are assessed.
Feedback will be provided based on clarity of
presentation, structure and time.
5% Mid-term
10% Final
T In-team assessment At the end of the semester, the section “my
contribution” has to be completed, after agreeing
with all team members. This section should contain
a brief summary of what you did, information on the
amount of work you have done in the team and
how you contributed.
10%
Categories
are graded in %.
Final Grade:
5-4*sqrt(0.6*D*Q+0.1*W+0.05*B+0.05*P1+0.1*P2+0.1*T)
putting numbers to awesomeness
ROBOY.ORG
ORGANISATION
• HackRoboy 4: 13.4. – 15.4. (mandatory)
• Lab Course: 8 hours per week
• Start: Mo, 16.4. Intro Day 10 – 18h, Pizza provided– 16.4.+: First Weekly Meetings
– 21.6.: Mid Term Presentations
– 13.-17.8.: 1 week hackathon to complete projects.
– 17.8.: Final Presentations
• Roboy on Tour: 20.9. – 30.9.
• HackRoboy 5: 5.10. – 7.10.
schedule throughout the semester
ROBOY.ORG
DEADLINES & DATES
• 14.2. Apply in Matching System• 13.4. – 15.4. Hack Roboy 4• 16.4 Intro Day• 21.6. Release 2.9.0 (docs complete, code integrated)• 21.6. Mid Term Presentations• 13.8. – 17.8. 1 week hackathon• 17.8. Release 3.0.0 (docs complete, code integrated)• 17.8. Final Presentations • 5.10. – 7.10. Hack Roboy 5: implicit documentation review• 7.10. Hack Roboy Release 3.0.1 (docs updated)
stuff done, fixed in time
ROBOY.ORG
Professional tools & workflows
Soft-skills & project management
Apply your theoretical knowledge
Work with cutting-edge hard- &
software – it’s all there or we buy it.
WHY YOU SHOULD LIVE FOR ROBOYafter roboy will be a better you
community
network
skills
Find an awesome job or internship
Talk to corporates at events
Go to the most exciting labs
Only student team with a DJ
Regular social events & parties
Free beer, slippers & a shirt
ROBOY.ORG
AND THEN?collect the certificate, add it to your CV
ROBOY.ORG
THAT’S ITsee you next semester – or later
this presentation & more:www.roboy.org/join