Human Generated Data

Title

...until the Mouse is in the House

Date

1981-1982

People

Artist: Joseph Beuys, German 1921 - 1986

Artist: Adolf Luther, German 1912 - 1990

Publisher: Adolf Luther, German 1912 - 1990

Classification

Multiples

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, The Willy and Charlotte Reber Collection, Gift of Charlotte Reber, 1996.187

Copyright

© Artists Rights Society (ARS), New York

Human Generated Data

Title

...until the Mouse is in the House

People

Artist: Joseph Beuys, German 1921 - 1986

Artist: Adolf Luther, German 1912 - 1990

Publisher: Adolf Luther, German 1912 - 1990

Date

1981-1982

Classification

Multiples

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Apparel 99.4
Clothing 99.4
Hat 99.4
Human 99.3
Person 99.3
Person 99
Person 98.6
Hat 98
Cushion 92.6
Face 90.6
Shop 58.9
Bakery 58.9
Electronics 57.4
Screen 57.4
Pillow 56

Clarifai
created on 2021-04-03

man 99.5
woman 98.3
elderly 98
people 97.8
lid 97.8
two 97.7
indoors 97.1
adult 96.6
family 95.7
portrait 95.7
leisure 93.3
togetherness 93.2
love 92.4
friendship 90.2
enjoyment 88.9
room 87.9
veil 87.7
three 87.6
couple 87.2
sit 86.2

Imagga
created on 2021-04-03

person 33.8
toilet tissue 33.5
home 28.7
paper towel 27.9
smiling 27.5
tissue 26.6
adult 26
people 25.7
man 24.2
happy 23.8
towel 22.5
portrait 20.7
lifestyle 20.2
male 20
attractive 19.6
computer 19.2
smile 18.5
paper 18.3
laptop 17.3
face 17
room 16.4
sitting 16.3
indoors 14.9
couple 14.8
women 14.2
looking 13.6
happiness 13.3
pretty 12.6
senior 12.2
indoor 11.9
house 11.7
fun 11.2
cup 11.2
mature 11.2
technology 11.1
holding 10.7
fabric 10.6
working 10.6
bed 10.4
leisure 10
human 9.7
interior 9.7
one 9.7
together 9.6
elderly 9.6
hair 9.5
device 9.5
office 9.4
expression 9.4
relax 9.3
relaxing 9.1
health 9
student 9
lady 8.9
medical 8.8
child 8.8
education 8.7
eyes 8.6
model 8.6
modern 8.4
relaxation 8.4
care 8.2
handsome 8
container 8
cute 7.9
look 7.9
husband 7.9
hospital 7.7
old 7.7
wireless 7.6
studio 7.6
wife 7.6
relaxed 7.5
enjoyment 7.5
coffee 7.4
inside 7.4
treatment 7.3
cheerful 7.3
confident 7.3
school 7.2
love 7.1
patient 7.1
kid 7.1
work 7.1

Google
created on 2021-04-03

Forehead 98.5
Smile 92.2
Hat 86.7
Fedora 84.8
Signature 84.4
Autograph 75.5
T-shirt 74.5
Baseball cap 73.4
Sun hat 72.8
Font 70
Event 69
Cap 66.6
Photo caption 63.6
Happy 61.1
Room 60.8
Fun 58.1
Chef 57.7
Baseball 57.4
Cowboy hat 56.9
Autographed sports paraphernalia 56.4

Microsoft
created on 2021-04-03

human face 97.3
indoor 92.5
smile 90.8
person 79.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-61
Gender Male, 93.4%
Happy 91.7%
Fear 2.3%
Calm 1.9%
Surprised 1.4%
Angry 1.2%
Sad 0.6%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 40-58
Gender Female, 55.6%
Happy 83.7%
Calm 14.4%
Angry 0.6%
Surprised 0.6%
Sad 0.3%
Fear 0.2%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 42-60
Gender Male, 90.5%
Happy 92.1%
Calm 5.2%
Angry 0.6%
Surprised 0.6%
Confused 0.5%
Sad 0.4%
Fear 0.4%
Disgusted 0.2%

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.4%
Person 99.3%

Captions

Microsoft

Joseph Beuys, Joseph Beuys performing on a counter 80.3%
Joseph Beuys, Joseph Beuys posing for the camera 80.2%
Joseph Beuys, Joseph Beuys sitting on a counter 74.9%

Text analysis

Amazon

ntm