Human Generated Data

Title

Untitled (six girls in cat costumes on fence and crawling on ground)

Date

1934

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5714

Human Generated Data

Title

Untitled (six girls in cat costumes on fence and crawling on ground)

People

Artist: Durette Studio, American 20th century

Date

1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 96.8
Person 96.8
Person 95.5
Person 94.9
Clothing 94.3
Apparel 94.3
Person 93.5
Animal 79.1
Mammal 78.3
Person 77.1
Person 76.4
Pet 70.1
Canine 67.9
Poster 65.5
Collage 65.5
Advertisement 65.5
Toy 61
Costume 59.9
Furniture 56.6

Imagga
created on 2022-01-23

kin 47.9
man 24.8
people 18.4
world 16.7
black 16.2
male 15.6
person 15
portrait 14.9
city 14.1
adult 13.3
silhouette 12.4
statue 11.4
men 11.2
old 11.1
women 11.1
business 10.9
travel 10.6
art 10.1
monument 9.3
dark 9.2
dress 9
history 8.9
building 8.8
urban 8.7
walking 8.5
outdoor 8.4
sport 8.4
historic 8.2
tourism 8.2
transportation 8.1
businessman 7.9
architecture 7.8
sculpture 7.6
musical instrument 7.6
sax 7.5
happy 7.5
outdoors 7.5
famous 7.4
sexy 7.2
landmark 7.2
activity 7.2

Google
created on 2022-01-23

Photograph 94.3
Vertebrate 92.6
Black 89.9
Human 89.2
Black-and-white 87.3
Mammal 86.3
Style 84.2
Carnivore 82.3
Art 80.8
Toy 77.8
Felidae 77.7
Monochrome 76.8
Monochrome photography 76.1
Picture frame 74.9
Snapshot 74.3
Plant 72.6
Tree 71.8
Visual arts 68.9
Room 68.3
Stock photography 67.5

Microsoft
created on 2022-01-23

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-12
Gender Female, 100%
Happy 47.2%
Calm 24.7%
Surprised 9.4%
Angry 5.1%
Confused 4.7%
Sad 4.1%
Fear 3.2%
Disgusted 1.6%

AWS Rekognition

Age 6-14
Gender Female, 100%
Happy 49.9%
Calm 46.3%
Confused 1.4%
Disgusted 0.8%
Sad 0.6%
Surprised 0.4%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 4-12
Gender Female, 60.9%
Happy 100%
Surprised 0%
Angry 0%
Fear 0%
Sad 0%
Disgusted 0%
Confused 0%
Calm 0%

AWS Rekognition

Age 6-14
Gender Male, 97%
Calm 99.6%
Happy 0.2%
Sad 0.1%
Angry 0.1%
Disgusted 0%
Surprised 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 2-8
Gender Female, 99.7%
Happy 98.1%
Surprised 1.2%
Calm 0.3%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 6-16
Gender Male, 84.6%
Calm 99.6%
Sad 0.3%
Confused 0%
Surprised 0%
Happy 0%
Fear 0%
Angry 0%
Disgusted 0%

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.8%

Captions

Microsoft

a group of people standing in front of a window 88.7%
a group of people sitting in front of a window 82%
a group of people in front of a window 81.9%

Text analysis

Amazon

32AB
32AB VT-342 взайзы
взайзы
VT-342