AR logo.png

ANNIN ROBOTICS

0
  • HOME

  • TUTORIALS

  • DOWNLOADS & MANUALS

  • ROBOT KITS

  • FORUM

  • BLOG

  • CONTACT

  • More

    preview-blocker.popup
    1. ROBOT FORUM
    2. Robot Builds
    3. AR2 FROM FRANCE
    Search
    Nicolas
    Apr 18, 2019

    AR2 FROM FRANCE

    Hi there!

    I am happy to share my first test with AR2, ROS, Kinect, and tensorflow. I use pretrained fasterRCNN (https://github.com/tensorflow/models/tree/master/research/object_detection) and depth map from the Kinect to find the XYZ coordinates of an apple. It works but I think a simple openCVpipeline should be more efficient than deep learning vision algorithm . For the next step I will finish ROS integration (ROS_control), try Opencv pipeline and the DOPE algorithm from Nvidia. It can run on real time with a single RGB cam and returns 6Dpose estimation of an object (https://github.com/NVlabs/Deep_Object_Pose)!!! Thanks for making this project available to the open source community! AR2 is really awesome!!





    https://www.youtube.com/watch?v=RF4OBCECsmY&feature=youtube

    19 comments
    Harry Olthof
    Apr 18, 2019

    Impressif

    Chris Annin
    Apr 19, 2019

    Thats amazing. how are you controlling the robot step/dir outputs through ROS? you say you haven't finish ROS control yet?


    thanks for sharing.

    0
    Nicolas
    Apr 19, 2019

    Hi Chris thank you for sharing your project!!

    Actually is really simple thanks to you. the demo from moveit already has a controller. If you update random goal and click on plane and execute button, moveit will publish all the joint positions on a topic called “/movegroup/fake_trajectorycontroller .

    I just write a simple python subscriber to receive data from the topic and send command to the Arduino.

    In a terminal I launch the demo.launch file from ar2_moveit_config package

    In an other terminal I launch my script:

    -load all the global variables you define in your source file

    -load the serial connection

    -calibrate all motors with calRobotAll() function

    -move in home position (the same as you can see in moveit)

    Then I have a simple loop and I read joint values from the fake trajectory topic, convert them from radian to degree and send them to the Arduino through your MoveNew() function.


    It is important to update joint limits in the Urdf file and modified negangllim posinglimit global variables in order to match the real AR2 position and the moviet AR2 position.


    I can make a tutorial and share it with my code!

    It’s really easy to run if you have ros install

    London Moscow
    Apr 30, 2019

    Hi Nicolas, this is very impressive. Can you make a tutorial and share the necessary codes. That will be awesome!!

    0
    Nicolas
    May 1, 2019

    Hi! Thank you for your interest. Concerning the tuto and the code I have not finished yet, I need more time to write the tutorial and finished ros_control integration. I would prefer release clean code. But if you give me an email adress I can send you the code and the first version of the tutorial. Your feedback will be very usefull to me.

    London Moscow
    May 16, 2019

    Hi, thanks for message. My email is londonmoscow2016@gmail.com . Look forward to hear from you.

    0
    Paul
    May 22, 2019

    I'd love to take a look as well. My email is paulmclaugh@gmail.com

    0
    Daniel
    May 23, 2019

    Hello Nicolas,


    i ordered this book "Programming Robots with ROS" you have there on your desk when doing the ROS - Kinect video of yours. I totally fancy this stuff.

    It's months already that i have my AR2 hardware kit laying around. In the meantime i learn a bit from contributing members waiting for the "perfect" start.

    Anyhow, i also might want to take a look at the code of yours.

    My @mail adress is daniel_glaab@gmx.de . Thanks a lot.


    Daniel

    0
    Load more replies
    Celestino Azcarate
    Nov 8, 2019

    Muy bien 😀 si haces un tutorial de este robot con ROS agradeceria que me lo enviará gracias celesazk@gmail.com

    0
    sam
    Nov 12, 2019

    bonjour nicolas,

    c'est un très bon projet que tu réalise.

    je souhaiterais realisé un bras AR3 j'aurais aimé te posé des questions directement a ce sujet, est il possible d'en discuté en privé?

    je te laisse mon mail:

    samuelmahmutovic@yahoo.com


    merci d'avance

    0
    Thefuture youtube
    Nov 25, 2019

    excellent

    0
    Thefuture youtube
    Nov 25, 2019

    Thank you. for sharing your code. I am interesting this project also.


    0
    Sergio #
    Jan 24, 2020

    Please, can you share the code with me, too? I am struggling trying to connect AR2 to ROS and I am facing with multiple errors I don't know how to solve. Please, your help will be very useful.

    0
    Sergio #
    Feb 5, 2020

    Please, can you share the code with me, too? I am struggling trying to connect AR2 to ROS and I am facing with multiple errors I don't know how to solve. Please, your help will be very useful.

    My email is sergiofernandezleon22@gmail.com

    0
    Kstan Simit
    Dec 15, 2020

    Hi, any guy here successfully make AR2/3 work with ROS? If yes can share it out at github or youtube?

    0