Human Generated Data

Title

Untitled (people in Indian costumes inside tipi)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16903

Human Generated Data

Title

Untitled (people in Indian costumes inside tipi)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.7
Person 99.7
Person 99.5
Person 99.4
Person 98.6
Person 97.8
Person 97.6
Person 96
Person 95.3
Person 94.7
People 94.4
Person 93.7
Person 92.9
Person 90.7
Person 89.1
Person 87.9
Crowd 84.1
Person 73.4
Face 73.2
Team Sport 71.2
Sports 71.2
Hockey 71.2
Team 71.2
Sport 71.2
Photography 62.7
Photo 62.7
Text 59.3
Audience 58.1
Tie 57.1
Accessories 57.1
Accessory 57.1
Art 57
Drawing 57

Imagga
created on 2022-02-26

person 23.4
man 22.8
people 20.1
male 19.8
party 17.2
silhouette 14.9
business 14.6
art 14.5
dance 14.2
hand 12.9
glass 12.2
player 12.1
black 12
drawing 11.9
music 11.7
medical 11.5
celebration 11.2
men 11.1
team 10.7
design 10.7
businessman 10.6
human 10.5
group 10.5
grunge 10.2
clothing 9.8
fun 9.7
crowd 9.6
happy 9.4
event 9.2
sport 9.1
figure 9.1
medicine 8.8
professional 8.8
graphic 8.7
symbol 8.7
hands 8.7
adult 8.6
golfer 8.4
gold 8.2
worker 8.1
decoration 8.1
women 7.9
dancer 7.9
disco 7.7
leader 7.7
dancing 7.7
health 7.6
show 7.6
work 7.5
doctor 7.5
style 7.4
glasses 7.4
coat 7.2
baron 7.1
face 7.1
life 7.1

Google
created on 2022-02-26

Photograph 94.2
Window 87.3
Style 83.9
Black-and-white 82.3
Art 81.1
Monochrome 73.4
Font 73.1
Monochrome photography 72.5
Event 70
Pattern 69.2
Visual arts 69.1
T-shirt 66.1
Illustration 65.5
Stock photography 65.3
Vintage clothing 65.2
Painting 64.7
Room 64.1
Hat 63.3
History 60.7
Suit 57.7

Microsoft
created on 2022-02-26

text 99
drawing 99
sketch 97.4
cartoon 94.8
posing 88
group 59.5
old 57.8

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Female, 92%
Happy 54.2%
Calm 15.4%
Disgusted 9.4%
Surprised 9.1%
Angry 4.7%
Sad 4%
Confused 2%
Fear 1.3%

AWS Rekognition

Age 14-22
Gender Male, 98.8%
Happy 49.4%
Sad 20.8%
Calm 19.4%
Disgusted 3.6%
Surprised 2.7%
Confused 1.6%
Angry 1.5%
Fear 1%

AWS Rekognition

Age 27-37
Gender Female, 70.2%
Sad 65.8%
Surprised 12.2%
Fear 6%
Angry 5.5%
Happy 3.5%
Confused 2.6%
Disgusted 2.4%
Calm 2%

AWS Rekognition

Age 37-45
Gender Female, 74.7%
Sad 69.5%
Happy 12.6%
Calm 7%
Confused 5.4%
Angry 2.1%
Disgusted 1.9%
Surprised 0.9%
Fear 0.6%

AWS Rekognition

Age 40-48
Gender Male, 99.6%
Sad 49.3%
Confused 23.6%
Happy 19.4%
Calm 3.7%
Surprised 2.2%
Disgusted 1.1%
Angry 0.5%
Fear 0.3%

AWS Rekognition

Age 40-48
Gender Male, 98.5%
Sad 72.6%
Happy 13%
Confused 10.2%
Calm 1.7%
Disgusted 1.1%
Angry 0.6%
Surprised 0.4%
Fear 0.4%

AWS Rekognition

Age 48-56
Gender Male, 98.1%
Calm 48.8%
Sad 30.1%
Confused 8.5%
Happy 6.2%
Fear 2.4%
Disgusted 1.9%
Angry 1.2%
Surprised 1%

AWS Rekognition

Age 31-41
Gender Male, 98.6%
Sad 47.4%
Angry 21.5%
Calm 14.7%
Confused 4.4%
Happy 4.2%
Disgusted 3.7%
Fear 2.5%
Surprised 1.7%

AWS Rekognition

Age 30-40
Gender Male, 99.5%
Calm 70.6%
Sad 18.4%
Happy 5.9%
Confused 2.9%
Surprised 0.7%
Angry 0.7%
Disgusted 0.6%
Fear 0.2%

AWS Rekognition

Age 34-42
Gender Female, 98.4%
Happy 82.9%
Disgusted 13.1%
Calm 1.5%
Surprised 0.8%
Confused 0.7%
Fear 0.4%
Sad 0.3%
Angry 0.3%

AWS Rekognition

Age 23-33
Gender Female, 57.7%
Happy 98.6%
Surprised 0.9%
Sad 0.1%
Calm 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 38-46
Gender Female, 69.8%
Calm 74.3%
Happy 10.3%
Sad 6%
Confused 5%
Angry 1.3%
Surprised 1.1%
Fear 1%
Disgusted 0.9%

AWS Rekognition

Age 30-40
Gender Male, 92%
Sad 73.3%
Calm 11%
Happy 8.1%
Confused 3.3%
Angry 1.6%
Surprised 1.1%
Disgusted 1%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Tie 57.1%

Captions

Microsoft

a group of people posing for a photo 87.3%
a group of people posing for the camera 87.2%
a group of people posing for a picture 87.1%

Text analysis

Amazon

2

Google

MJI7--YT3RA°2 - - XAGOX LLGS SSS
LLGS
-
XAGOX
MJI7--YT3RA°2
SSS