Human Generated Data

Title

Untitled (public auction, A.H. Buchwalter farm, near Hilliards, Ohio)

Date

August 6, 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.773

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (public auction, A.H. Buchwalter farm, near Hilliards, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 6, 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.773

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 100
Adult 98
Male 98
Man 98
Person 98
Adult 97.9
Male 97.9
Man 97.9
Person 97.9
Adult 97.9
Male 97.9
Man 97.9
Person 97.9
Adult 97.1
Male 97.1
Man 97.1
Person 97.1
Adult 96.5
Person 96.5
Female 96.5
Woman 96.5
Adult 96.3
Male 96.3
Man 96.3
Person 96.3
Person 95.3
Person 95.2
Adult 93.8
Male 93.8
Man 93.8
Person 93.8
Hat 93.7
Person 93.3
Person 93.3
Adult 93
Male 93
Man 93
Person 93
Accessories 92
Bag 92
Handbag 92
Adult 91.5
Male 91.5
Man 91.5
Person 91.5
Person 91.3
Person 87.3
Hat 86
Face 85.9
Head 85.9
Person 85.3
Person 84.8
Hat 82.1
Person 81.7
Person 81.6
Hat 77
Hat 74.6
Hat 74.4
Person 73.4
Person 70.9
Hat 69.4
Formal Wear 67.9
Tie 67.9
Hat 65.8
Person 64.8
Musical Instrument 62.8
Person 58
Performer 55.8
Group Performance 55.7
Leisure Activities 55.7
Music 55.7
Music Band 55.7
Musician 55.7
Guitar 55.5
Banjo 55.3
People 55.2
Hat 55.1

Clarifai
created on 2018-05-11

people 99.9
group 99.4
group together 99.2
many 98.8
adult 98.7
several 95.7
veil 95.7
man 94.1
wear 93.4
administration 93.3
leader 93
vehicle 92.5
watercraft 90.5
outfit 90.1
military 88.6
woman 88.2
lid 87
recreation 84.4
war 84.4
five 81.8

Imagga
created on 2023-10-06

man 34.2
musical instrument 31.3
people 27.3
male 25.6
percussion instrument 23.9
drum 20.7
person 19.2
uniform 18.1
men 18
work 16.5
military 16.4
war 15.4
equipment 14
weapon 14
adult 13.9
hat 13.7
hand 13.7
clothing 13.7
gun 13.1
music 12.8
soldier 12.7
mask 12.6
banjo 12.1
stringed instrument 11.8
worker 11.6
playing 10.9
industrial 10.9
army 10.7
portrait 10.3
industry 10.2
city 10
device 10
battle 9.8
musical 9.6
musician 9.2
protection 9.1
human 9
couple 8.7
rock 8.7
hospital 8.6
helmet 8.5
two 8.5
nurse 8.4
sound 8.4
old 8.4
leisure 8.3
occupation 8.2
outdoors 8.2
washboard 8.1
player 8.1
activity 8.1
job 8
medical 7.9
conflict 7.8
band 7.8
instrument 7.7
care 7.4
surgeon 7.4
entertainment 7.4
danger 7.3
history 7.1
smile 7.1
family 7.1
patient 7.1
brass 7.1
travel 7
together 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 99.3
outdoor 91.8
people 63
group 59.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-42
Gender Male, 75.6%
Calm 99%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Confused 0.3%
Angry 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 45-53
Gender Female, 69.7%
Calm 97.2%
Surprised 6.9%
Fear 5.9%
Sad 2.2%
Angry 0.5%
Confused 0.3%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 6-14
Gender Female, 98%
Happy 82.7%
Confused 12.6%
Surprised 6.6%
Fear 5.9%
Sad 2.3%
Calm 2.2%
Disgusted 0.7%
Angry 0.6%

AWS Rekognition

Age 41-49
Gender Male, 98.6%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 3.6%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.6%
Calm 32.9%
Angry 20.2%
Disgusted 18.9%
Confused 16.3%
Surprised 7.5%
Sad 6.4%
Fear 6.1%
Happy 1%

AWS Rekognition

Age 40-48
Gender Male, 95.6%
Calm 72%
Fear 8.9%
Sad 8.1%
Surprised 6.7%
Happy 3.6%
Angry 3.1%
Disgusted 2.8%
Confused 1.1%

AWS Rekognition

Age 43-51
Gender Male, 98%
Sad 99.8%
Calm 21.6%
Confused 6.8%
Surprised 6.4%
Fear 6%
Angry 1.3%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 38-46
Gender Female, 99%
Happy 43%
Calm 39.5%
Confused 8%
Surprised 7.6%
Fear 6.9%
Sad 2.9%
Disgusted 1.3%
Angry 1%

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Adult 98%
Male 98%
Man 98%
Person 98%
Female 96.5%
Woman 96.5%
Hat 93.7%
Handbag 92%
Tie 67.9%