Human Generated Data

Title

Untitled (large group of diners sitting at banquet tables)

Date

c. 1950

People

Artist: Jack Rodden Studio, American 1914 - 2016

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13607

Human Generated Data

Title

Untitled (large group of diners sitting at banquet tables)

People

Artist: Jack Rodden Studio, American 1914 - 2016

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-04

Human 98
Person 98
Person 97.6
Person 97.5
Person 96.6
Person 96.3
Person 95.7
Person 95.5
Person 91
Person 90.7
Crowd 90.1
Audience 90.1
Restaurant 89
Person 88.5
Person 87.3
Person 80.5
Food 77.4
Meal 77.4
Cafeteria 76.5
People 75.9
Chair 75.5
Furniture 75.5
Sitting 71.8
Indoors 71.2
Person 69.7
Person 69.6
Person 64.5
Room 63
Person 61.5
Person 60.8
Photography 59.9
Photo 59.9
Porch 59.1
Classroom 58.3
School 58.3
Suit 56
Apparel 56
Clothing 56
Coat 56
Overcoat 56
Chair 53.8
Person 51.3

Imagga
created on 2022-02-04

classroom 29.1
room 28.7
people 22.8
man 18.1
old 16.7
building 16.1
business 15.2
city 14.9
male 13.5
architecture 13.3
hall 12.9
shop 12.6
person 12.6
stall 12.5
computer 12.1
men 12
adult 11.6
urban 11.3
group 10.5
black 10.2
indoor 10
office 9.9
women 9.5
restaurant 9.3
house 9.2
interior 8.8
spectator 8.8
glass 8.5
art 8.4
senior 8.4
modern 8.4
mercantile establishment 8
businessman 7.9
window 7.9
portrait 7.8
sitting 7.7
crowd 7.7
hand 7.6
chair 7.6
silhouette 7.4
vintage 7.4
inside 7.4
light 7.3
night 7.1
passenger 7.1

Google
created on 2022-02-04

Adaptation 79.2
Art 78.8
Font 77.3
Monochrome 73.9
Monochrome photography 73.5
Event 73.3
Suit 69.5
Team 68.2
Chair 64.9
Stock photography 62.7
Room 62.4
History 62
Audience 60.4
Crowd 56.4
Photo caption 56.1
Visual arts 55.5
Class 52.8

Microsoft
created on 2022-02-04

person 99.1
text 97.1
clothing 94.2
man 85.8
people 73
human face 59.4
crowd 57
woman 56.2
group 55.9

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Male, 99.7%
Sad 90.2%
Confused 4.6%
Calm 1.8%
Disgusted 1%
Fear 0.7%
Happy 0.6%
Surprised 0.6%
Angry 0.4%

AWS Rekognition

Age 22-30
Gender Male, 74.8%
Calm 99.2%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Happy 0.1%
Sad 0%

AWS Rekognition

Age 27-37
Gender Female, 53.5%
Sad 33.5%
Confused 27.8%
Calm 16.8%
Disgusted 12.4%
Angry 5.1%
Happy 2%
Surprised 1.8%
Fear 0.6%

AWS Rekognition

Age 39-47
Gender Male, 82.1%
Calm 97.5%
Sad 1.1%
Angry 0.5%
Disgusted 0.2%
Surprised 0.2%
Confused 0.2%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Female, 70.1%
Calm 97.6%
Happy 0.9%
Sad 0.5%
Surprised 0.4%
Confused 0.2%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 38-46
Gender Male, 97.3%
Calm 52.9%
Surprised 34.9%
Angry 5.2%
Happy 4%
Disgusted 1.2%
Confused 0.7%
Sad 0.6%
Fear 0.5%

AWS Rekognition

Age 37-45
Gender Male, 90.2%
Calm 97.6%
Sad 1.2%
Confused 0.4%
Surprised 0.4%
Disgusted 0.1%
Happy 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 41-49
Gender Male, 94.1%
Calm 79.1%
Sad 10.8%
Surprised 6.7%
Angry 1%
Confused 0.9%
Disgusted 0.7%
Happy 0.6%
Fear 0.3%

AWS Rekognition

Age 16-24
Gender Female, 73.2%
Sad 77.6%
Angry 14.3%
Fear 2.5%
Disgusted 2.2%
Calm 1.4%
Confused 1%
Surprised 0.5%
Happy 0.4%

AWS Rekognition

Age 20-28
Gender Female, 69.9%
Sad 78.7%
Calm 18.1%
Fear 0.8%
Confused 0.7%
Surprised 0.6%
Disgusted 0.5%
Angry 0.4%
Happy 0.3%

AWS Rekognition

Age 18-26
Gender Female, 89.2%
Confused 51.9%
Sad 36.3%
Happy 4.5%
Calm 3.7%
Fear 1.6%
Disgusted 1.1%
Surprised 0.5%
Angry 0.4%

AWS Rekognition

Age 51-59
Gender Male, 61.8%
Calm 97.7%
Happy 1.2%
Confused 0.4%
Disgusted 0.3%
Sad 0.2%
Surprised 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 13-21
Gender Female, 50%
Calm 89.6%
Fear 7.5%
Confused 1%
Sad 0.7%
Disgusted 0.4%
Happy 0.3%
Angry 0.2%
Surprised 0.2%

AWS Rekognition

Age 26-36
Gender Male, 80.6%
Happy 48.4%
Disgusted 36.4%
Confused 3.5%
Fear 3.3%
Calm 3%
Sad 2.3%
Surprised 1.8%
Angry 1.3%

AWS Rekognition

Age 23-31
Gender Female, 98%
Happy 44.1%
Calm 33.8%
Sad 7%
Fear 3.8%
Angry 3.6%
Confused 2.7%
Disgusted 2.5%
Surprised 2.4%

AWS Rekognition

Age 23-31
Gender Male, 92.9%
Fear 98.8%
Calm 0.5%
Happy 0.3%
Surprised 0.1%
Sad 0.1%
Confused 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 2-8
Gender Female, 76.9%
Sad 93.2%
Fear 2.7%
Calm 1.8%
Angry 1.5%
Surprised 0.2%
Confused 0.2%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Female, 82.2%
Calm 84.5%
Surprised 4.1%
Confused 4%
Angry 2.7%
Sad 2.1%
Happy 0.9%
Disgusted 0.9%
Fear 0.8%

AWS Rekognition

Age 10-18
Gender Female, 87.6%
Fear 89.2%
Calm 5.5%
Sad 1.5%
Confused 1.5%
Surprised 1.1%
Angry 0.5%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 25-35
Gender Male, 97.7%
Confused 94.4%
Sad 2.9%
Calm 1%
Angry 0.6%
Surprised 0.4%
Disgusted 0.4%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 2-8
Gender Male, 80.2%
Sad 35.8%
Calm 32.9%
Disgusted 10.8%
Confused 7.8%
Angry 4.7%
Happy 3.2%
Fear 3.2%
Surprised 1.7%

AWS Rekognition

Age 11-19
Gender Female, 98.7%
Sad 75.5%
Confused 11.6%
Fear 4.4%
Calm 4.1%
Surprised 2%
Disgusted 1%
Angry 0.9%
Happy 0.5%

AWS Rekognition

Age 22-30
Gender Male, 93.9%
Disgusted 28.6%
Confused 24.2%
Sad 19%
Calm 16.8%
Fear 4.9%
Angry 3.3%
Happy 2.1%
Surprised 1.1%

AWS Rekognition

Age 2-8
Gender Female, 54.4%
Calm 90.3%
Sad 3.8%
Confused 1.8%
Disgusted 1.4%
Happy 1%
Surprised 0.8%
Fear 0.6%
Angry 0.3%

AWS Rekognition

Age 30-40
Gender Male, 99%
Calm 88.4%
Happy 3.7%
Sad 3.6%
Confused 3.1%
Surprised 0.5%
Disgusted 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 16-24
Gender Female, 58.5%
Calm 57.7%
Surprised 16.9%
Fear 12.1%
Sad 5.4%
Confused 5.3%
Angry 1.1%
Disgusted 0.9%
Happy 0.5%

AWS Rekognition

Age 19-27
Gender Female, 62.4%
Calm 86.7%
Sad 9%
Confused 2.1%
Happy 1.2%
Angry 0.5%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 2-8
Gender Female, 95.7%
Confused 83.9%
Calm 5%
Happy 3.4%
Angry 2.3%
Sad 2.3%
Disgusted 1.8%
Surprised 0.6%
Fear 0.6%

AWS Rekognition

Age 11-19
Gender Female, 53.5%
Calm 56.6%
Sad 27.5%
Happy 4.6%
Confused 4.4%
Fear 2.4%
Disgusted 1.8%
Angry 1.6%
Surprised 1%

AWS Rekognition

Age 20-28
Gender Female, 90.4%
Fear 86.3%
Calm 4.8%
Surprised 2.4%
Sad 2.1%
Angry 1.4%
Disgusted 1.2%
Happy 0.9%
Confused 0.9%

AWS Rekognition

Age 18-26
Gender Female, 76.5%
Calm 87%
Sad 4.1%
Angry 3.1%
Confused 2.4%
Disgusted 1.2%
Fear 0.9%
Surprised 0.6%
Happy 0.6%

AWS Rekognition

Age 19-27
Gender Male, 58.4%
Fear 83.4%
Surprised 10.4%
Calm 4.4%
Angry 0.5%
Confused 0.4%
Sad 0.3%
Happy 0.3%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 98%
Chair 75.5%

Captions

Microsoft

a group of people standing in front of a crowd 88.7%
a group of people standing in front of a crowd of people 87.1%
a group of people in front of a crowd 87%

Text analysis

Amazon

5
KODAK
SAFETY
STAR
RISING
CHAITIE
Nas

Google

KOBAK
ET KOBAK SAFETY
ET
SAFETY