Human Generated Data

Title

Boy with Puppet

Date

1979-1983

People

Artist: Mary E. Frey, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.650

Copyright

© Mary E. Frey

Human Generated Data

Title

Boy with Puppet

People

Artist: Mary E. Frey, American 20th century

Date

1979-1983

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-03

Furniture 100
Human 99.4
Person 99.4
Apparel 99.2
Clothing 99.2
Footwear 99.2
Shoe 99.2
Person 96.8
Shoe 95.7
Cabinet 95.5
Bedroom 85.9
Room 85.9
Indoors 85.9
Dresser 82.9
Bed 74.4
Drawer 72.5

Clarifai
created on 2021-04-03

people 99.9
two 98.8
woman 98.1
room 96.4
adult 96.1
man 95.4
group 93.1
furniture 93.1
group together 92.4
three 91.9
child 91.5
portrait 91.3
monochrome 91.2
cabinet 90.1
family 86.3
home 86.2
wear 85.9
indoors 85.3
one 84.2
luggage 83.8

Imagga
created on 2021-04-03

file 34.4
office furniture 28.2
furniture 27.3
box 22.3
indoors 20.2
people 19.5
interior 19.4
container 19
person 18.3
business 18.2
man 18.1
room 17.5
office 17.2
adult 15.7
home 15.1
male 14.9
attractive 14.7
happy 13.8
house 13.4
work 13.3
black 12.6
equipment 12.5
boxes 10.7
carton 10.7
smile 10.7
fashion 10.5
computer 10.5
storage 10.5
success 10.5
device 10.3
smiling 10.1
suit 9.9
modern 9.8
pretty 9.8
locker 9.7
machine 9.6
lifestyle 9.4
casual 9.3
confident 9.1
portrait 9.1
old 9.1
lady 8.9
businessman 8.8
child 8.6
happiness 8.6
corporate 8.6
bag 8.5
businesswoman 8.2
cheerful 8.1
new 8.1
transportation 8.1
worker 8
women 7.9
men 7.7
wall 7.7
moving 7.6
fastener 7.5
city 7.5
technology 7.4
style 7.4
service 7.4
brown 7.4
laptop 7.3
clothing 7.2
refrigerator 7.2
hair 7.1
handsome 7.1
to 7.1
travel 7

Google
created on 2021-04-03

Microsoft
created on 2021-04-03

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-14
Gender Male, 90%
Calm 92.5%
Sad 4.8%
Surprised 1.1%
Confused 0.7%
Angry 0.6%
Fear 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 19-31
Gender Female, 70.9%
Surprised 80.6%
Fear 8.2%
Happy 7.4%
Confused 1.4%
Calm 0.9%
Angry 0.7%
Sad 0.4%
Disgusted 0.3%

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 17
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Shoe 99.2%

Captions

Microsoft

Charlie McCarthy standing in front of a refrigerator 57.9%
Charlie McCarthy sitting in front of a refrigerator 43.1%
Charlie McCarthy that is standing in front of a refrigerator 43%