Human Generated Data

Title

Untitled (escorts at debutante ball)

Date

c. 1950

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21539

Human Generated Data

Title

Untitled (escorts at debutante ball)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.3
Human 99.3
Tie 98.9
Accessory 98.9
Accessories 98.9
Person 98.6
Person 98.3
Person 97.8
Clothing 97.4
Apparel 97.4
Person 96.6
Person 96.4
Person 96.2
Coat 96.1
Overcoat 96.1
Person 95.6
Person 95.1
Person 94.8
Suit 94.6
Person 94
Person 93.3
Person 93.2
Person 91.1
Person 90.4
Person 88.7
People 88.3
Tie 87.8
Dress 87.4
Face 86.7
Person 84.8
Person 83.6
Person 82.6
Crowd 80.8
Person 79.8
Suit 76.3
Person 75.1
Indoors 73.4
Tuxedo 72.3
Person 70.4
Suit 67.3
Photography 65.7
Photo 65.7
Portrait 65.7
Female 65.4
Room 57.7
Stage 57
Shirt 56.7
Tie 56.2
Classroom 55.6
School 55.6
Furniture 55.4

Imagga
created on 2022-03-05

kin 35.6
man 30.2
person 27.7
people 25.6
male 24.9
child 19
sport 18.5
world 18.4
happy 16.9
adult 16.8
player 15.6
teacher 15.5
silhouette 14.9
boy 14.8
men 14.6
fun 14.2
smiling 13
active 12.9
group 12.9
black 12.6
portrait 12.3
grunge 11.9
ball 11.9
team 11.6
school 10.5
student 10.5
style 10.4
women 10.3
action 10.2
girls 10
aged 9.9
old 9.7
businessman 9.7
together 9.6
athlete 9.4
casual 9.3
classroom 9.2
teen 9.2
business 9.1
dirty 9
guy 8.8
lifestyle 8.7
holiday 8.6
youth 8.5
ballplayer 8.5
friends 8.4
senior 8.4
attractive 8.4
dark 8.3
joy 8.3
color 8.3
teenager 8.2
success 8
educator 8
musical instrument 8
family 8
dance 7.9
urban 7.9
couple 7.8
happiness 7.8
face 7.8
play 7.7
party 7.7
run 7.7
dancing 7.7
professional 7.7
performer 7.7
power 7.5
fashion 7.5
field 7.5
leisure 7.5
room 7.5
outdoors 7.5
life 7.2
recreation 7.2
game 7.1
smile 7.1
modern 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

person 99.3
clothing 97
outdoor 92.1
man 91.6
text 83.9
woman 83.5
house 74.7
footwear 69.3
posing 68.6
group 61.6
old 44
crowd 0.6

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 87.1%
Sad 52.7%
Happy 19.9%
Calm 17.8%
Confused 3.8%
Disgusted 2.1%
Angry 2%
Fear 0.9%
Surprised 0.9%

AWS Rekognition

Age 30-40
Gender Male, 98.6%
Confused 59.4%
Sad 30.1%
Surprised 4.4%
Happy 2.1%
Fear 1.4%
Angry 1.1%
Calm 0.9%
Disgusted 0.6%

AWS Rekognition

Age 38-46
Gender Male, 73.7%
Sad 75.8%
Happy 14.8%
Confused 3.4%
Calm 1.9%
Disgusted 1.7%
Fear 1.1%
Angry 0.7%
Surprised 0.6%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Sad 51.1%
Calm 18.1%
Happy 14.3%
Confused 8.6%
Angry 2.3%
Fear 2.2%
Disgusted 1.9%
Surprised 1.4%

AWS Rekognition

Age 42-50
Gender Male, 98.9%
Sad 66.6%
Happy 17.5%
Confused 11%
Disgusted 1.6%
Angry 1.1%
Calm 1%
Surprised 0.8%
Fear 0.5%

AWS Rekognition

Age 33-41
Gender Female, 93.1%
Sad 51.1%
Angry 21.4%
Happy 7.1%
Confused 6.6%
Calm 4.7%
Surprised 4.1%
Disgusted 2.9%
Fear 2.3%

AWS Rekognition

Age 35-43
Gender Female, 50.9%
Calm 42.5%
Happy 29.4%
Sad 21.5%
Confused 3.5%
Disgusted 1.3%
Angry 1.1%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 48-54
Gender Male, 96%
Happy 63.4%
Sad 18%
Confused 9.7%
Calm 4.7%
Disgusted 1.9%
Surprised 1.3%
Angry 0.7%
Fear 0.4%

AWS Rekognition

Age 36-44
Gender Male, 97.2%
Sad 56.1%
Confused 39.4%
Calm 1.5%
Disgusted 1.1%
Happy 1%
Angry 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 42-50
Gender Male, 78.5%
Happy 65.6%
Sad 19.2%
Confused 10.9%
Calm 1.8%
Disgusted 1%
Angry 0.7%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 27-37
Gender Male, 95.6%
Sad 87.7%
Happy 8.9%
Disgusted 1%
Confused 1%
Angry 0.4%
Surprised 0.3%
Calm 0.3%
Fear 0.3%

AWS Rekognition

Age 48-56
Gender Male, 79.8%
Sad 62.4%
Confused 30.8%
Happy 3.1%
Disgusted 1.3%
Calm 0.8%
Angry 0.6%
Surprised 0.6%
Fear 0.4%

AWS Rekognition

Age 48-54
Gender Male, 100%
Calm 69.4%
Confused 21.5%
Sad 2.8%
Disgusted 2%
Happy 1.6%
Surprised 1.2%
Angry 1.1%
Fear 0.3%

AWS Rekognition

Age 35-43
Gender Female, 96.4%
Happy 99.5%
Sad 0.1%
Calm 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 95.9%
Sad 97.9%
Happy 0.9%
Disgusted 0.4%
Confused 0.3%
Calm 0.2%
Angry 0.2%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 21-29
Gender Female, 78.3%
Calm 41.7%
Sad 41.4%
Happy 9.3%
Confused 3.3%
Disgusted 1.4%
Fear 1.2%
Surprised 0.9%
Angry 0.8%

AWS Rekognition

Age 34-42
Gender Male, 97.2%
Happy 80.4%
Calm 13.5%
Confused 3.3%
Sad 1.4%
Disgusted 0.7%
Surprised 0.4%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 50-58
Gender Male, 98%
Sad 56.2%
Happy 25.3%
Calm 6.7%
Confused 4.6%
Surprised 2.9%
Fear 2.2%
Disgusted 1.1%
Angry 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.3%
Tie 98.9%
Suit 94.6%

Captions

Microsoft

a group of people posing for a photo 93.4%
a group of people standing in front of a crowd posing for the camera 89.8%
a group of people posing for the camera 89.7%

Text analysis

Amazon

D18
KODAKSA