Human Generated Data

Title

Untitled (baby in rocking chair holding teddy bear)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17139

Human Generated Data

Title

Untitled (baby in rocking chair holding teddy bear)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Furniture 100
Chair 100
Human 94.9
Person 94.2
Shoe 88.3
Clothing 88.3
Apparel 88.3
Footwear 88.3
Face 85.4
Floor 83.4
Flooring 80.9
Baby 80.8
Shoe 79
Photography 77.5
Portrait 77.5
Photo 77.5
Indoors 76.6
Person 76.3
Kid 67.8
Child 67.8
Shoe 67.6
Play 65.5
Shorts 63.7
Rocking Chair 61.4
Table 59.7
People 58.5
Dress 56.8

Imagga
created on 2022-02-26

football helmet 100
helmet 100
headdress 76.2
clothing 53.8
brass 27
covering 26.2
man 26.2
consumer goods 25.4
people 25.1
person 24.9
male 20.6
wind instrument 19.8
adult 17.9
sport 17.3
lifestyle 14.4
cornet 14.1
musical instrument 13.6
human 12.7
mask 11.8
bugle 11.7
black 11.4
men 11.2
casual 11
suit 10.8
face 10.6
play 10.3
action 10.2
professional 10.1
protection 10
exercise 10
outdoor 9.9
dress 9.9
active 9.9
fashion 9.8
portrait 9.7
costume 9.6
body 9.6
motion 9.4
happiness 9.4
teenager 9.1
worker 8.9
happy 8.8
love 8.7
day 8.6
life 8.6
legs 8.5
art 8.5
leisure 8.3
gun 8.3
holding 8.2
style 8.2
fitness 8.1
weapon 8
home 8
ball 8
urban 7.9
smile 7.8
boy 7.8
color 7.8
uniform 7.7
skill 7.7
studio 7.6
fun 7.5
one 7.5
music 7.4
wedding 7.4
security 7.4
teen 7.3
business 7.3
danger 7.3
team 7.2
astronaut 7.1
game 7.1
work 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

person 91.4
text 89.2
clothing 63.6
black and white 54
jumping 53

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 99.5%
Happy 66.9%
Calm 16.3%
Surprised 5.4%
Fear 4%
Angry 2.5%
Confused 2.1%
Disgusted 1.7%
Sad 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.2%
Shoe 88.3%

Captions

Microsoft

a man jumping in the air doing a trick on a skateboard 49.4%
a man doing a trick on a skateboard 47.7%
a young man jumping in the air doing a trick on a skateboard 36.4%

Text analysis

Amazon

Adox
YY3-A2