Human Generated Data

Title

Untitled (escorts at debutante ball)
Date

c. 1950
People

Artist: John Howell, American active 1930s-1960s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21539

Human Generated Data

Title

Untitled (escorts at debutante ball)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21539

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.3
Human 99.3
Tie 98.9
Accessories 98.9
Accessory 98.9
Person 98.6
Person 98.3
Person 97.8
Clothing 97.4
Apparel 97.4
Person 96.6
Person 96.4
Person 96.2
Overcoat 96.1
Coat 96.1
Person 95.6
Person 95.1
Person 94.8
Suit 94.6
Person 94
Person 93.3
Person 93.2
Person 91.1
Person 90.4
Person 88.7
People 88.3
Tie 87.8
Dress 87.4
Face 86.7
Person 84.8
Person 83.6
Person 82.6
Crowd 80.8
Person 79.8
Suit 76.3
Person 75.1
Indoors 73.4
Tuxedo 72.3
Person 70.4
Suit 67.3
Portrait 65.7
Photography 65.7
Photo 65.7
Female 65.4
Room 57.7
Stage 57
Shirt 56.7
Tie 56.2
Classroom 55.6
School 55.6
Furniture 55.4

Clarifai
created on 2023-10-22

people 99.9
group 99.8
many 99.2
leader 98.7
group together 98.3
administration 97.7
adult 95.2
man 94.8
several 93.4
woman 90.2
education 88.5
child 86
school 83.4
war 83.2
chair 82.3
wear 82.1
offense 73
music 72.5
home 69.9
military 69.5

Imagga
created on 2022-03-05

kin 35.6
man 30.2
person 27.7
people 25.6
male 24.9
child 19
sport 18.5
world 18.4
happy 16.9
adult 16.8
player 15.6
teacher 15.5
silhouette 14.9
boy 14.8
men 14.6
fun 14.2
smiling 13
active 12.9
group 12.9
black 12.6
portrait 12.3
grunge 11.9
ball 11.9
team 11.6
school 10.5
student 10.5
style 10.4
women 10.3
action 10.2
girls 10
aged 9.9
old 9.7
businessman 9.7
together 9.6
athlete 9.4
casual 9.3
classroom 9.2
teen 9.2
business 9.1
dirty 9
guy 8.8
lifestyle 8.7
holiday 8.6
youth 8.5
ballplayer 8.5
friends 8.4
senior 8.4
attractive 8.4
dark 8.3
joy 8.3
color 8.3
teenager 8.2
success 8
educator 8
musical instrument 8
family 8
dance 7.9
urban 7.9
couple 7.8
happiness 7.8
face 7.8
play 7.7
party 7.7
run 7.7
dancing 7.7
professional 7.7
performer 7.7
power 7.5
fashion 7.5
field 7.5
leisure 7.5
room 7.5
outdoors 7.5
life 7.2
recreation 7.2
game 7.1
smile 7.1
modern 7

Google
created on 2022-03-05

Photograph 94.3
Black 89.6
Coat 88.1
Black-and-white 83.8
Suit 83.1
Monochrome photography 74.9
Snapshot 74.3
Monochrome 73.2
Vintage clothing 72.5
Event 71.6
Art 71.1
Room 70.6
Stock photography 64.9
Font 64.9
History 63.5
Team 61.9
Sitting 60
Photo caption 59.7
Photographic paper 53.5
Family 53

Microsoft
created on 2022-03-05

person 99.3
clothing 97
outdoor 92.1
man 91.6
text 83.9
woman 83.5
house 74.7
footwear 69.3
posing 68.6
group 61.6
old 44
crowd 0.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 87.1%
Sad 52.7%
Happy 19.9%
Calm 17.8%
Confused 3.8%
Disgusted 2.1%
Angry 2%
Fear 0.9%
Surprised 0.9%

AWS Rekognition

Age 30-40
Gender Male, 98.6%
Confused 59.4%
Sad 30.1%
Surprised 4.4%
Happy 2.1%
Fear 1.4%
Angry 1.1%
Calm 0.9%
Disgusted 0.6%

AWS Rekognition

Age 38-46
Gender Male, 73.7%
Sad 75.8%
Happy 14.8%
Confused 3.4%
Calm 1.9%
Disgusted 1.7%
Fear 1.1%
Angry 0.7%
Surprised 0.6%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Sad 51.1%
Calm 18.1%
Happy 14.3%
Confused 8.6%
Angry 2.3%
Fear 2.2%
Disgusted 1.9%
Surprised 1.4%

AWS Rekognition

Age 42-50
Gender Male, 98.9%
Sad 66.6%
Happy 17.5%
Confused 11%
Disgusted 1.6%
Angry 1.1%
Calm 1%
Surprised 0.8%
Fear 0.5%

AWS Rekognition

Age 33-41
Gender Female, 93.1%
Sad 51.1%
Angry 21.4%
Happy 7.1%
Confused 6.6%
Calm 4.7%
Surprised 4.1%
Disgusted 2.9%
Fear 2.3%

AWS Rekognition

Age 35-43
Gender Female, 50.9%
Calm 42.5%
Happy 29.4%
Sad 21.5%
Confused 3.5%
Disgusted 1.3%
Angry 1.1%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 48-54
Gender Male, 96%
Happy 63.4%
Sad 18%
Confused 9.7%
Calm 4.7%
Disgusted 1.9%
Surprised 1.3%
Angry 0.7%
Fear 0.4%

AWS Rekognition

Age 36-44
Gender Male, 97.2%
Sad 56.1%
Confused 39.4%
Calm 1.5%
Disgusted 1.1%
Happy 1%
Angry 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 42-50
Gender Male, 78.5%
Happy 65.6%
Sad 19.2%
Confused 10.9%
Calm 1.8%
Disgusted 1%
Angry 0.7%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 27-37
Gender Male, 95.6%
Sad 87.7%
Happy 8.9%
Disgusted 1%
Confused 1%
Angry 0.4%
Surprised 0.3%
Calm 0.3%
Fear 0.3%

AWS Rekognition

Age 48-56
Gender Male, 79.8%
Sad 62.4%
Confused 30.8%
Happy 3.1%
Disgusted 1.3%
Calm 0.8%
Angry 0.6%
Surprised 0.6%
Fear 0.4%

AWS Rekognition

Age 48-54
Gender Male, 100%
Calm 69.4%
Confused 21.5%
Sad 2.8%
Disgusted 2%
Happy 1.6%
Surprised 1.2%
Angry 1.1%
Fear 0.3%

AWS Rekognition

Age 35-43
Gender Female, 96.4%
Happy 99.5%
Sad 0.1%
Calm 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 95.9%
Sad 97.9%
Happy 0.9%
Disgusted 0.4%
Confused 0.3%
Calm 0.2%
Angry 0.2%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 21-29
Gender Female, 78.3%
Calm 41.7%
Sad 41.4%
Happy 9.3%
Confused 3.3%
Disgusted 1.4%
Fear 1.2%
Surprised 0.9%
Angry 0.8%

AWS Rekognition

Age 34-42
Gender Male, 97.2%
Happy 80.4%
Calm 13.5%
Confused 3.3%
Sad 1.4%
Disgusted 0.7%
Surprised 0.4%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 50-58
Gender Male, 98%
Sad 56.2%
Happy 25.3%
Calm 6.7%
Confused 4.6%
Surprised 2.9%
Fear 2.2%
Disgusted 1.1%
Angry 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person
Tie
Suit
Person 99.3%
Person 98.6%
Person 98.3%
Person 97.8%
Person 96.6%
Person 96.4%
Person 96.2%
Person 95.6%
Person 95.1%
Person 94.8%
Person 94%
Person 93.3%
Person 93.2%
Person 91.1%
Person 90.4%
Person 88.7%
Person 84.8%
Person 83.6%
Person 82.6%
Person 79.8%
Person 75.1%
Person 70.4%
Tie 98.9%
Tie 87.8%
Tie 56.2%
Suit 94.6%
Suit 76.3%
Suit 67.3%

Text analysis

Amazon

D18
KODAKSA