Hi everyone, welcome to Hack Chat today. I'm Dan and I'll be moderating for Hans Forsberg, who has been doing some interesting work exploring animal intelligence. @hfor62, are you online yet?

Nicolas Tremblay12:00 PM
You don't fix the tapes first?

deʃhipu12:00 PM
I think you forgot resistors for those leds

Ahron Wayne12:00 PM
It's time for birds!

Bird hacking -- wait, it's not Thanksgiving yet...

hfor6212:01 PM
Hi there I'm online

Nicolas Tremblay12:01 PM
don't confuse bird hacking and hacking birds

deʃhipu12:02 PM
avian flu

Ahron Wayne12:02 PM
Avians Fly

deʃhipu12:02 PM
khe khe

Hi Hans, welcome to the Hack Chat. Can you start things off with a little about how you got into this area?

hfor6212:02 PM
Yes!

hfor6212:02 PM
When I turned six, I got an electric construction box. Since then, I have been enchanted by electricity, electronics and computers.

Through a long professional career, I now have the opportunity to work with smart colleagues and together we apply AI and

machine-learning to real applications such as robotic lawnmowers.

hfor6212:03 PM
When I turned six, I got an electric construction box. Since then, I have been enchanted by electricity, electronics and computers.

Through a long professional career, I now have the opportunity to work with smart colleagues and together we apply AI and

machine-learning to real applications such as robotic lawnmowers.

hfor6212:03 PM
Anyway, most of what I have created has been further development

of existing solutions, quite naturally, but when I saw our garden magpie-pair unlock the rather complicated locking

mechanism in the lanterns we exhibited in the winter darkness, my curiosity was aroused. The magpies were looking for the

paraffin candles that were in the lanterns, could I challenge the magpies to solve missions?

Finally a hobby project where I got to start from scratch. There were no how-to's to google here, it was entirely up to me!

hfor6212:03 PM
At the same time, a hot topic with a lot of ongoing research:

Interesting, wonder why they wanted the candles

hfor6212:04 PM
Here are two interesting articles about corvids

https://www.nationalgeographic.com/animals/2019/02/new-caledonian-crows-plan-ahead-with-tools/

https://www.bbc.com/future/article/20191211-crows-could-be-the-smartest-animal-other-than-primates

hfor6212:04 PM
I think the candle (IKEA) are pure paraffine...rocket fule for birds as long as vegetarian..

hfor6212:05 PM
There is so much to say about the magpies, We have had a beautiful pair in the garden ever since we bought the

house 20 years ago...yes i understand the birds are not the same...it looks even more complicated...

Ahron Wayne12:05 PM
I liked one of the suggestions someone had that you train them to pick up coins instead of bottlecaps. Though you might get into trouble when they realize that people carry said coins.

I chose that picture of the magpie because you can just tell by looking at them that there's a lot going on inside that tiny brain.

Ahron Wayne12:06 PM
Build a tiny vending machine, let them pick the snacks

Stephen12:06 PM
Can you post a view of the bird box from further back so we can see the entire structure? I've seen the close up images of the deck but wanted to see the hopper at the top that delivers the food.

hfor6212:06 PM
Over here there arent much coins any longer

Ahron Wayne12:06 PM
Bitcoins then

A different sort of bitcoin mining, eh?

Ahron Wayne12:07 PM
Right. initial IPO 100 million

hfor6212:07 PM

Stephen12:07 PM
Thanks Hans!

deʃhipu12:07 PM
corvids are the only animals we know that can recognize humans by their faces

hfor6212:07 PM
I'll try to find an image of the complete upper box

Morning.Star12:08 PM
I had a pair of 'pies nest in the tree outside my bedroom window and they were a pain, they yelled at me every morning and evening for turning on lights in the room.

They built a fence in front of the nest in the end. ;-)

Stephen12:08 PM
Won't be long before the birds figure out how to just get at the booty in the top I suspect!

hfor6212:09 PM
Have you everheard of the young girl ho fed crows, and got gifts back.

Stephen12:09 PM
Vaguely familiar. Was it one of Aesop's fables?

hfor6212:10 PM
A few weeks ago, suddeny there was an old rust M4 bolt close to the place where the food is dispensed...

hfor6212:10 PM

https://youtu.be/n44g9fQYiXE

YouTube KaFaDoKyA NEWS

Ahron Wayne12:10 PM
I saw that, it was great!

hfor6212:10 PM
No... more like this some 5 years ago...

Ahron Wayne12:11 PM
You should try to get them to do this --- just little nice looking things in general. Coins, bottlecaps, etc. Maybe you'll get a ring or two.

Lex Kravitz joined the room.12:11 PM

hfor6212:11 PM
Yes, and another day...some magpie gave a small piece of cristmas decoration from last yer...

hfor6212:11 PM
whar will come...

Ahron Wayne12:12 PM
Did you see the kickstarter that was about identifying birds at a feeder?

hfor6212:12 PM
Actueally, the surroundings is quite clean

hfor6212:12 PM
Not much vaste

Ahron Wayne12:12 PM
Maybe they'll pick stuff up from further away though

hfor6212:12 PM
So i have to hide bottlecaps in the garden

Lex Kravitz12:12 PM
Amazing project! I'm curious how you came up with using the vibration dispensing mechanism instead of some type of rotating hopper - can you comment on the pros/cons of this mechanism?

hfor6212:12 PM
they easily pic 50-60 a day

It's interesting that those crows only really seemed to return "treasures", as opposed to random garbage like cigarette butts and such. Unless the humans edited out the junk, that's pretty discriminating behavior

hfor6212:13 PM
I tried more ore lees all 'screw-mechanism' pet feeder style alternatives from thingiverse...useless...stuck and jam

hfor6212:14 PM
the vibrating solution is what they use in industri...foolprof

deʃhipu12:14 PM
there is lots of folk tales about magpies "stealing" small objects

hfor6212:14 PM
Thats the type of experience i want to share with you...

deʃhipu12:15 PM
of course they don't have any idea of ownership, so they can't really steal

deʃhipu12:15 PM
they just collect

hfor6212:15 PM
Yes...magpies has a lot of stories in 'folklore *

Any sign that the vibrations from the feeder scared the birds? Probably would initially, I'd think.

hfor6212:16 PM
Now, really, o was conidering if they could carry apples from my lawn...

deʃhipu12:16 PM
you need to train hedgehogs for that

hfor6212:16 PM
But that season is already to an end...

hfor6212:16 PM
Seems like it has to be covids or maybe squirrels

deʃhipu12:17 PM
eels

deʃhipu12:17 PM
electric ones

hfor6212:17 PM
Even raccoons and pigs have been trained

Ahron Wayne12:17 PM
How about training them to voluntarily wear cameras for a little while?

Ahron Wayne12:17 PM
You can even train c. elegans, nematodes with 302 neurons

hfor6212:18 PM
I have some contact with a professor in this topic at Stockholm university

Ahron Wayne12:18 PM
get them to like a food that normally means danger

hfor6212:18 PM
This professor, asked me to watch out for a strange behaviour

hfor6212:19 PM
Pigs and raccoons tend to look at the 'payment' as food aftera while

hfor6212:19 PM
Lika a internal battle in the brain between genetic codes, and new stuff they had learned...

hfor6212:20 PM
No such problems with magpies

hfor6212:20 PM
https://royalsocietypublishing.org/doi/full/10.1098/rsos.160734

https://royalsocietypublishing.org/doi/10.1098/rsos.181777

hfor6212:20 PM
My original experiments has been with an adult pair last winter and early this spring. They are quite neophobic so I had to have

patience...slightest change in the rig or equipment, and the adults were suspicious for a day or so.... this has been the

birds I ‘have worked with for a few years

Nicolas Tremblay12:21 PM
How exactly did you train them?

hfor6212:21 PM
But this spring, four chicks where hatched, and these chicks (the nest is in a cherry three close to the machine..)

started to investigate the machine, after a while the adult-parents were gone...haven't seen them since. The chicks are more

brave, almost stupid as teenagers...one walked straight into our kitchen. The parents knew some tricks, like pushing a

special red button to get a reward, but as I said, now it's the chicks from the spring that is operating the machine.

hfor6212:21 PM
But this spring, four chicks where hatched, and these chicks (the nest is in a cherry three close to the machine..)

started to investigate the machine, after a while the adult-parents were gone...haven't seen them since. The chicks are more

brave

hfor6212:22 PM
There is a quite new video explaining this

hfor6212:22 PM

hfor6212:23 PM
i arranged a setup where the birds accidentally forced bottlecaps into a hole, and got a reward

Ahron Wayne12:23 PM
Are you worried at all that your birds are being conditioned to get their foods from humans, and won't know how to properly forage once you stop feeding them?

Ahron Wayne12:23 PM
Since you said they learned as young chicks

hfor6212:24 PM
Not really, the seems to be to smart for that.

hfor6212:24 PM
From time to time the dissaper for a whole day or more...probably seeking food somewhere else

hfor6212:24 PM
and that even if the garden is full of bottlecaps

Stephen12:24 PM
Everyone likes variety

hfor6212:25 PM
But a feed the with a mix of peanuts, dog -food, and cat food

Stephen12:25 PM
Trail mix for birds

hfor6212:25 PM
The seem to have a rather small territory, lika a few houses around mine

hfor6212:26 PM
Have a look for yourselfs when you drive around urban areas, how often do you spot magpies.

hfor6212:26 PM
Magpies are not as famous for intelligence as eg caledonian crow...

Ahron Wayne12:27 PM
Never, because I live in US

Just reading about their nesting and territorial behaviors now, interesting birds

Ahron Wayne12:27 PM
So I wonder if this is possible with the dumb sparrows that live around me instead

hfor6212:27 PM
But, since the seem to stay in a small territory, the are easy to work with and super curious

hfor6212:27 PM
Sorry...dont think so.

Stephen12:28 PM
I've only seen them in Colorado. I live in West Texas and the only birds we have a lot of here are doves, buzzards, robins, blue jays and mocking birds. There are some grackles, but they hang out in fast food parking lots because they are junk food junkies.

hfor6212:28 PM
In ealy experiments, the birds had to lif a acrylic 'see-through' lid to get the rewar, and for me to detect the action

@Ahron Wayne - we have them out west. Strikingly beautiful birds, I was so pleased to see a species I'd never seen before after living back East for all my life

hfor6212:29 PM
There where small sparrows and other porr birrds lokking through the glass understanding nada

hfor6212:29 PM
Here in scandinavia we have the eurasian magpie

hfor6212:30 PM
Actually, and quite surprisingly, right now, it seems like there is only one of three chicks that can handle the bottle-cap trick...

the others are trying to steal the reward.

'

Ours in the Rockies are the black-billed magpie, which is virtually identical in appearance and behavior

hfor6212:31 PM
Another, really unexpected experience:

deʃhipu12:31 PM
you really need corvids or parrots

deʃhipu12:31 PM
they are the only birds that have neocortex

hfor6212:32 PM
Then there was a hostile take-over of the territory with some really interesting observations, but I’ll leave that for now…

Suddenly, a friday afternoon, and a journalist from Swedish national radio was planned to visit my garden the next monday, there was a big fight in the cherry-tree close to the birdbox. Several magpies 6-8, where fighting wildly...The next day...the box was dead. No more bottle-caps collected

Ahron Wayne12:32 PM
:(

deʃhipu12:32 PM
funnily, there are some fish that have it too

hfor6212:32 PM
The most likely explanation is that another gang of three ‘new’ magpies had conquered the territory from the original gang of three magpie chicks.

deʃhipu12:32 PM
so you could probably train a goldfish

Oh man, that probably set you back a bit

Stephen12:33 PM
Did you share that story with your professor acquaintance?

Ahron Wayne12:33 PM
Do you think you could recognize the individual birds (by yourself or with AI)? After all, it's not fair that we label them as smart when they can recognize us but we can't do the same with them

hfor6212:33 PM
There 'was' an old correlation between the size of the brain and intelligence...exept elephants...

deʃhipu12:33 PM
size of brain in proportion to the body

hfor6212:34 PM
The corvids has a brain with the size of a nut

deʃhipu12:34 PM
and a body with the size of a corvid

hfor6212:34 PM
Actually, the neurons in the corvid brain is tighter packed

hfor6212:35 PM
One wonder at what price...you almost never gets something for free from Darwin

deʃhipu12:35 PM
constant weltschmertz probably

hfor6212:36 PM
I could separeta the birds as chicks, as their colors was vage and more or less dense...but now it's really hard

Ahron Wayne12:36 PM
The biggest problem is that we can never really ask these animals. Who knows how intelligent a 200 year old sperm whale really is?

deʃhipu12:36 PM
@hfor62 may be interesting to photograph them in UV, they are not black then

hfor6212:36 PM
Since it semms like there is only one out of tree birds doing the trick i wonder it thas the female...

deʃhipu12:37 PM
their sight it shifted towards the uv spectrum, and they don't see each other as black

hfor6212:37 PM
But distinguishing between the gender seems to be possibel only when the mate or hatch

Ahron Wayne12:38 PM
Try putting a UV pass filter on your camera then?

hfor6212:38 PM
Ok, UV you say, i'll give that a try.

hfor6212:39 PM
I have a Google-Coral -raspberry setup that can classify 1000 species of bird, so maybe training your own network could work...but still, we have to annotate the training data catch 22

Ahron Wayne12:40 PM
Do you think the same network could be used on insects?

hfor6212:40 PM
Would be interesting to setup a general classification tool, such as an AI-camera

Black-billed magpies here in the US are often seen picking ticks off cattle. I wonder if that behavior could be leveraged somehow to do useful work

Ahron Wayne12:40 PM
viewed with a usb microscope

hfor6212:40 PM
The google Coral alredy provides a insect network

Ahron Wayne12:40 PM
oooh

hfor6212:40 PM
As well a plant network

Ahron Wayne12:42 PM
Cool, thanks, taking a look

hfor6212:42 PM
In norther europe we currently have huge problem with a small Work/caterpillar or whatever you would call this 3 mm insect, totally destroing our pinewoods

hfor6212:43 PM
That would be a challange for tons of trained birds, and tons of peanuts...

hfor6212:44 PM
But for the general detector i suess i still have to train a network myself

hfor6212:44 PM
Cigarett-buts and garden slugs is on my list

Really hard to keep ahead of insect infestations, they're so prolific and so tiny.

hfor6212:44 PM

hfor6212:45 PM

hfor6212:45 PM
The huge image net has almost any training data you could ask for.

hfor6212:46 PM
But, still, retraining a neural network is simpel in theory...but more like a craftmanship in reality

hfor6212:47 PM

Morning.Star12:48 PM

https://www.independent.co.uk/news/world/americas/bird-recycling-plastic-bottle-disney-viral-raven-corvid-a9075191.html

The Independent

Bird filmed recycling plastic bottle

A remarkable viral video shows a raven collecting an empty plastic drinks bottle and taking it to a recycling bin where it deposits it before flying away, leaving the world a slightly tidier place. The white-necked raven was seen doing its bit for the planet at Disney's Animal Kingdom in Florida.

Read this on The Independent

hfor6212:48 PM
Found an image of the 'bird-detector i was taking about, an RPI + Coral, a small camera in front and the result ona a display

Non-ICE12:48 PM
I just joined and don't know if you already answered this: How did you get the birds to catch on the idea in the first place?

hfor6212:49 PM
I arranged bottlecaps in a way that the accidentally forced them into a hole...and then got reward

hfor6212:49 PM

hfor6212:50 PM
Then yet a step

hfor6212:50 PM

hfor6212:51 PM
A step wher they had to 'lift' the bottle cap into the hole

Nicolas Tremblay12:51 PM
So literally "a step"

hfor6212:51 PM
then placing the bottle caps on the ground etc etc

hfor6212:52 PM
Regarding the footage above with birds and PET bottles...

hfor6212:52 PM
I'm considering going for soda cans next...2 Swedish krona each

hfor6212:53 PM

hfor6212:54 PM
Soda cans could also be classified with a metaldetector.

Any idea how much payload they can carry? And no jokes about coconuts, anyone...

hfor6212:55 PM
Of course it would be cool with an AI based multipurpose classifier, but i'm old enough (or to bad engineer) to know to keep things simple and take small steps forward...

hfor6212:56 PM
I have no idea what the can carry...the are quite bad flyers...or not, the fly as good as the need...

hfor6212:57 PM
But i colud put the calssifier on the ground if they took care of my 'fall-fruit' thats messing with the robo-mover

Yeah, they're not gracefull, are they? Big birds, though, lots of wing area -- bet they can lift a lot. They've been known to move their eggs if the nest is disturbed, so they can carry at tleast as much as the egg weighs.

hfor6212:57 PM
By the way...i have work 15 years with robotic lawnmovers, but thats another hack-chat maybe...

Nicolas Tremblay12:58 PM
What if 2 birds use a sling?

Yes, definitely!

hfor6212:58 PM
Now we are talking

hfor6212:58 PM
That video-clip would finally make me a YouTuber

@Nicolas Tremblay - don't get us started...

hfor6212:59 PM
Think i told

hfor6212:59 PM
think i told you about the territory takeover

hfor621:00 PM
Thats another example of unexpected surprises from mother nature.

Morning.Star1:00 PM
I was telling a friend about an article I read a few weeks ago, parrots...

There was an experiment done where they were given tokens to exchange for food, similar to the experiment with apes and money. Anyway, the birds were given equal amounts of tokens to exchange for food, and then when they had learned this as a group certain birds were given excess tokens and others none.

Well as it turned out the birds with excess tokens donated them to birds with none, so the community as a whole got fed. The apes learned to use their tokens to exchange for sex/status in comparison. I cant find the article or I'd post it, it was rather interesting.

Well, it's been a fast hour, and a fascinating one at that. Hans, thanks so much for making time for us and talking about this project. It's a little outside our usual fare but still really cool stuff. And I'm going to make a note to invite you back on in 2021 for a chat about robotic lawnmowers.

hfor621:02 PM
Really interesting, and some animals also managed the trick of 'waiting for a while' , not eating the tasty bit...and get twice the amount if they wait...

Nicolas Tremblay1:03 PM
Thanks Hans, and sign me up for the robo-mower

hfor621:03 PM
Thanks Dan, my pleasure

Morning.Star1:03 PM
Yeah thanks, that was fascinating :-)

hfor621:04 PM
I'will post more material, plans code etc on Hackaday, along with more video on YouTube

Thanks everyone for the great chat. Don't forget next week we'll have everyone's favorite artisenal Nixie tube maker Dalibor Farny:


https://hackaday.io/event/175084-the-art-of-nixies-hack-chat

Hackaday

Discussions