Human Generated Data

Title

Untitled (crowd of alumni under a tent, Princeton University reunion, Princeton, NJ)
Date

c. 1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8180
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd of alumni under a tent, Princeton University reunion, Princeton, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Audience 99.5
Crowd 99.5
Human 99.5
Person 98.7
Person 98.7
Person 97.7
Person 97.4
Person 95.7
Person 93.7
Person 93.5
Person 93.3
Person 92.4
Person 92.4
Person 91.2
Person 91
Person 85.9
Person 85.2
Clothing 84.5
Apparel 84.5
Person 84.3
Person 84.2
Person 83.5
People 82.5
Person 82.5
Person 81.1
Suit 73.5
Coat 73.5
Overcoat 73.5
Person 73.4
Person 73.2
Person 71
Face 68.8
Musician 67.2
Musical Instrument 67.2
Text 66.9
Sitting 66.3
Portrait 61.9
Photography 61.9
Photo 61.9
Meal 59.9
Food 59.9
Speech 57.9
Guitarist 56.2
Leisure Activities 56.2
Guitar 56.2
Performer 56.2
Person 54.6
Person 46.6

Imagga
created on 2022-01-08

music 31.6
musical instrument 30.9
stringed instrument 28.6
bowed stringed instrument 27.7
man 25.5
concert 23.3
people 22.3
violin 21.2
bass 20.8
person 20.1
guitar 20.1
male 19.8
stage 18.9
black 18.6
musician 18.4
adult 18.1
group 17.7
singer 17.5
musical 17.2
hand 15.2
wind instrument 14.9
silhouette 14.9
brass 14.4
studio 14.4
crowd 14.4
rock 13.9
party 12.9
entertainment 12.9
grunge 12.8
sing 12.8
dance 12.7
club 12.2
microphone 12.2
instrument 12.1
play 12.1
performance 11.5
art 11.2
style 11.1
disco 11.1
teacher 10.5
performer 10.5
men 10.3
sound 10.3
lifestyle 10.1
guitarist 9.8
platform 9.8
fun 9.7
design 9.6
show 9.5
star 9.4
event 9.2
girls 9.1
trombone 9
night 8.9
song 8.8
couple 8.7
women 8.7
light 8.7
dancing 8.7
player 8.6
youth 8.5
paint 8.1
handsome 8
businessman 7.9
classroom 7.9
business 7.9
viola 7.9
nightlife 7.8
hands 7.8
audience 7.8
wall 7.7
friends 7.5
room 7.5
leisure 7.5
smoke 7.4
symbol 7.4
street 7.4
dancer 7.3
speaker 7.3
painting 7.2

Google
created on 2022-01-08

Black 89.6
Organism 86.5
Black-and-white 82.7
Font 80.9
Adaptation 79.3
Event 73.8
Art 72.5
Crowd 71.1
Monochrome photography 70.6
Team 70.3
Monochrome 70.2
Suit 70
Room 69.7
Pattern 67.1
History 65.1
Stock photography 63.4
Crew 60.4
Visual arts 59.3
Rectangle 53.1
Illustration 52.4

Microsoft
created on 2022-01-08

person 99.2
text 99.2
clothing 92.2
man 90.8
drawing 85.9
people 78.2
group 69.7
human face 69.3
crowd 56.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 98.9%
Calm 64.4%
Sad 32.6%
Confused 1%
Fear 0.6%
Angry 0.5%
Disgusted 0.4%
Surprised 0.4%
Happy 0.2%

AWS Rekognition

Age 37-45
Gender Male, 85.8%
Calm 42.9%
Sad 34.1%
Confused 20.8%
Surprised 0.7%
Angry 0.5%
Fear 0.4%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 39-47
Gender Male, 97.8%
Calm 92.1%
Sad 4.8%
Happy 1.8%
Surprised 0.4%
Angry 0.3%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Female, 54.9%
Calm 89.9%
Happy 2.3%
Surprised 1.8%
Confused 1.6%
Sad 1.5%
Angry 1.4%
Disgusted 1.2%
Fear 0.3%

AWS Rekognition

Age 35-43
Gender Female, 81.2%
Happy 94.8%
Calm 4.8%
Surprised 0.2%
Sad 0.1%
Disgusted 0%
Angry 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 98.9%
Sad 73.5%
Calm 12.7%
Angry 3.8%
Disgusted 2.7%
Confused 2.6%
Happy 2.6%
Surprised 1.5%
Fear 0.5%

AWS Rekognition

Age 42-50
Gender Male, 100%
Calm 61.3%
Sad 14.9%
Confused 8.6%
Disgusted 5.4%
Happy 5.4%
Surprised 1.6%
Angry 1.5%
Fear 1.2%

AWS Rekognition

Age 25-35
Gender Male, 92.1%
Sad 54.8%
Calm 28.7%
Happy 5%
Fear 3.8%
Disgusted 3%
Confused 3%
Angry 0.9%
Surprised 0.7%

AWS Rekognition

Age 52-60
Gender Male, 83.7%
Calm 95.1%
Sad 4%
Happy 0.2%
Confused 0.2%
Disgusted 0.2%
Angry 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 37-45
Gender Male, 99.6%
Sad 46.4%
Happy 21.3%
Calm 10.9%
Confused 8.8%
Fear 8.3%
Disgusted 2.3%
Angry 1.2%
Surprised 0.7%

AWS Rekognition

Age 24-34
Gender Female, 91.9%
Calm 52.8%
Sad 44.8%
Happy 0.6%
Confused 0.6%
Angry 0.4%
Surprised 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Sad 99.2%
Calm 0.3%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 97.8%
Sad 1.4%
Happy 0.3%
Confused 0.2%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 65.4%
Calm 92.7%
Sad 1.9%
Confused 1.8%
Disgusted 0.9%
Surprised 0.8%
Happy 0.8%
Fear 0.5%
Angry 0.5%

AWS Rekognition

Age 28-38
Gender Male, 99.6%
Sad 93.9%
Calm 3.2%
Confused 0.9%
Disgusted 0.7%
Angry 0.4%
Happy 0.4%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Calm 54%
Sad 29.7%
Confused 9.7%
Angry 3.1%
Disgusted 1.9%
Happy 0.8%
Surprised 0.7%
Fear 0.2%

AWS Rekognition

Age 29-39
Gender Female, 64.2%
Calm 97.1%
Happy 2.2%
Surprised 0.2%
Sad 0.2%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 31-41
Gender Male, 99.3%
Sad 63.2%
Calm 32.6%
Confused 1.1%
Fear 1%
Happy 0.8%
Surprised 0.5%
Disgusted 0.5%
Angry 0.3%

AWS Rekognition

Age 42-50
Gender Male, 98.2%
Calm 97.8%
Confused 0.8%
Sad 0.6%
Fear 0.2%
Happy 0.2%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 16-22
Gender Male, 68.1%
Calm 84.7%
Sad 8.9%
Angry 3.1%
Confused 1.3%
Happy 0.8%
Disgusted 0.6%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 26-36
Gender Female, 54.4%
Happy 54.8%
Calm 20.7%
Sad 12.7%
Fear 4.9%
Angry 2.7%
Disgusted 1.6%
Confused 1.4%
Surprised 1.2%

AWS Rekognition

Age 16-22
Gender Female, 50.5%
Sad 97.7%
Happy 0.7%
Calm 0.5%
Confused 0.4%
Fear 0.4%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a group of people watching a band on stage in front of a crowd 83.3%
a group of people standing in front of a crowd 83.2%
a group of people in front of a crowd 83.1%

Text analysis

Amazon

2
21
32

Google

TIVITE
TIVITE