Human Generated Data

Title

Bearded Man and Woman with Shawl, Lower East Side, New York City

Date

1910, printed later

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Naomi and Walter Rosenblum, P1979.75

Human Generated Data

Title

Bearded Man and Woman with Shawl, Lower East Side, New York City

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Date

1910, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Naomi and Walter Rosenblum, P1979.75

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Face 99.9
Human 99.9
Clothing 99.3
Apparel 99.3
Person 98.4
Person 97.7
Person 96.3
Hat 95.6
Beard 94.7
Person 87.4
Overcoat 74.5
Coat 74.5
Portrait 68.5
Photography 68.5
Photo 68.5
Finger 62.4
Suit 60.4
Meal 60.3
Food 60.3
Sitting 55.9

Clarifai
created on 2023-10-30

people 99.9
portrait 99.4
adult 99.2
man 98.4
street 96.8
veil 96.6
elderly 96.5
group 96.4
two 96
lid 95.9
woman 94.9
one 94.1
wear 92.8
group together 92
three 88.2
administration 87.2
actor 85.7
four 82.9
monochrome 81.2
leader 79.9

Imagga
created on 2022-05-28

man 37.2
male 34.9
adult 33.1
people 31.2
person 29.4
portrait 29.1
face 22.7
bow tie 22.4
sitting 18.9
looking 17.6
necktie 17
black 16.9
lifestyle 16.6
men 16.3
casual 16.1
handsome 16.1
happy 15
businessman 15
love 15
attractive 14.7
world 14.7
human 14.2
look 14
kin 13.8
indoor 13.7
alone 13.7
smile 13.5
business 13.4
couple 13.1
mustache 12.9
grandfather 12.9
office 12.9
suit 12.8
clothing 12.8
old 12.5
guy 12.5
one 11.9
serious 11.4
sexy 11.2
happiness 11
model 10.9
smiling 10.9
professional 10.3
garment 9.7
hair 9.5
expression 9.4
drink 9.2
leisure 9.1
pretty 9.1
fashion 9
jacket 8.9
indoors 8.8
1 8.7
day 8.6
drinking 8.6
corporate 8.6
only 8.6
elegant 8.6
businesspeople 8.5
friends 8.5
senior 8.4
head 8.4
mature 8.4
hand 8.4
room 8.3
eye 8
work 7.8
thinking 7.6
shirt 7.5
outdoors 7.5
single 7.4
worker 7.4
executive 7.4
entertainment 7.4
20s 7.3
cheerful 7.3
lady 7.3
women 7.1

Google
created on 2022-05-28

Hat 92.1
Beard 88.6
Fashion 88.4
Standing 86.4
Black-and-white 86
Sun hat 85.7
Fedora 84.4
Style 84
Cap 75.5
Event 74.2
Monochrome photography 74
Monochrome 73.4
Road 73.1
Street 70.1
Facial hair 69.7
Conversation 66.3
Moustache 66.1
Scarf 65.8
Stock photography 62.3
Wrinkle 60.6

Microsoft
created on 2022-05-28

person 99.1
human face 98.4
man 98
clothing 97.8
hat 97.7
fashion accessory 97
black and white 92.4
fedora 89.4
smile 88.5
monochrome 77
cowboy hat 70.8
sun hat 62.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-65
Gender Female, 95.7%
Angry 75.6%
Disgusted 9.7%
Surprised 7.2%
Fear 6.6%
Calm 4.6%
Sad 3.1%
Confused 2.7%
Happy 0.9%

AWS Rekognition

Age 52-60
Gender Male, 99.5%
Calm 83.1%
Surprised 6.6%
Fear 6.2%
Happy 4.9%
Sad 4.3%
Angry 3.8%
Disgusted 1%
Confused 0.7%

AWS Rekognition

Age 21-29
Gender Male, 93.7%
Sad 36.8%
Happy 26.7%
Disgusted 23%
Surprised 9.6%
Fear 8.5%
Confused 5.9%
Angry 5.2%
Calm 5%

Microsoft Cognitive Services

Age 69
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Hat 95.6%

Captions

Microsoft
created on 2022-05-28

a man wearing a hat 89.4%
a man wearing a hat and glasses 78.8%
a man in a hat 78.7%

Text analysis

Google

u