Human Generated Data

Title

Untitled (businesmen in suits, group portrait)

Date

1950s

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.602

Human Generated Data

Title

Untitled (businesmen in suits, group portrait)

People

Artist: Bachrach Studios, founded 1868

Date

1950s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 98.6
Apparel 97.8
Coat 97.8
Overcoat 97.8
Suit 97.8
Clothing 97.8
Tie 97.8
Accessories 97.8
Accessory 97.8
Person 97.5
Person 96.8
Tie 96.8
Person 96.8
Person 96.5
Person 96.1
Person 96.1
Person 95.9
Person 95.4
Person 94.5
Military 94.4
Military Uniform 94.4
Person 93.2
Person 91.5
Sitting 90.8
Suit 88.8
Person 87.2
Person 86.6
Person 83.9
Crowd 82.7
Audience 80.5
Suit 79.4
Tie 79.4
Suit 79
People 78.8
Attorney 77.9
Officer 77.1
Soldier 74.5
Suit 72.6
Suit 70.5
Armored 66.9
Army 66.9
Suit 65.2
Tie 62.1
Jury 57.8
Head 55.4

Imagga
created on 2022-01-23

brass 39
man 34.2
people 34
wind instrument 31.4
male 28.3
person 26.3
cornet 22.3
business 21.8
musical instrument 21.5
adult 20.6
group 20.1
businessman 18.5
men 17.2
couple 15.7
happy 15
office 14.5
indoors 14
team 13.4
meeting 13.2
smiling 13
colleagues 12.6
together 12.3
businesswoman 11.8
family 11.6
room 11.2
mature 11.1
love 11
suit 11
portrait 11
happiness 11
indoor 10.9
black 10.9
sax 10.9
professional 10.6
businesspeople 10.4
teacher 10
kin 9.8
cheerful 9.7
job 9.7
clothing 9.7
four 9.6
home 9.6
women 9.5
corporate 9.4
sitting 9.4
desk 9.4
lifestyle 9.4
trombone 9.3
teamwork 9.3
silhouette 9.1
working 8.8
planner 8.7
nurse 8.6
worker 8.5
window 8.5
old 8.4
interior 8
classroom 7.9
smile 7.8
standing 7.8
40s 7.8
mid adult 7.7
30s 7.7
thinking 7.6
senior 7.5
staff 7.5
inside 7.4
20s 7.3
celebration 7.2

Google
created on 2022-01-23

Coat 86.6
Suit 80.7
Blazer 77.2
Formal wear 75.3
Event 71.5
Vintage clothing 71
Classic 69.3
Crew 68.8
White-collar worker 68.5
Sitting 66.6
Monochrome 66.4
Team 63.1
Stock photography 62.4
History 61.8
Room 53.6

Microsoft
created on 2022-01-23

person 99.9
posing 97.9
clothing 97.8
man 95.8
group 92
suit 88.3
standing 86.6
text 82.5
smile 71.5
dressed 62.5
old 55.9
clothes 38.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Male, 80.8%
Happy 90.6%
Calm 6.6%
Surprised 0.8%
Confused 0.5%
Angry 0.5%
Disgusted 0.5%
Fear 0.3%
Sad 0.2%

AWS Rekognition

Age 24-34
Gender Male, 92.2%
Happy 97.4%
Calm 1.1%
Sad 0.3%
Surprised 0.3%
Angry 0.2%
Disgusted 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 64-74
Gender Male, 99.9%
Calm 97.6%
Angry 0.7%
Surprised 0.6%
Fear 0.3%
Disgusted 0.3%
Happy 0.2%
Sad 0.2%
Confused 0.2%

AWS Rekognition

Age 48-56
Gender Male, 100%
Happy 99.5%
Angry 0.2%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Sad 0%
Disgusted 0%
Calm 0%

AWS Rekognition

Age 51-59
Gender Male, 99.4%
Happy 97.8%
Angry 1.2%
Surprised 0.3%
Fear 0.2%
Disgusted 0.2%
Confused 0.2%
Sad 0.1%
Calm 0.1%

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Happy 86%
Calm 10.1%
Confused 1.3%
Surprised 0.7%
Fear 0.6%
Angry 0.5%
Disgusted 0.4%
Sad 0.4%

AWS Rekognition

Age 52-60
Gender Male, 99.9%
Happy 93%
Calm 3.4%
Surprised 1.2%
Confused 0.8%
Fear 0.5%
Disgusted 0.4%
Angry 0.4%
Sad 0.4%

AWS Rekognition

Age 57-65
Gender Male, 100%
Happy 99.2%
Surprised 0.2%
Fear 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Calm 0%
Sad 0%

AWS Rekognition

Age 66-76
Gender Male, 75.4%
Happy 98.3%
Angry 0.4%
Surprised 0.4%
Calm 0.3%
Fear 0.2%
Disgusted 0.2%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 73-83
Gender Male, 99.7%
Calm 84%
Happy 8.2%
Surprised 3%
Disgusted 1.3%
Angry 1.1%
Sad 0.8%
Confused 0.8%
Fear 0.8%

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 57%
Happy 35%
Surprised 1.8%
Angry 1.7%
Disgusted 1.6%
Confused 1.4%
Sad 0.9%
Fear 0.7%

AWS Rekognition

Age 67-77
Gender Male, 100%
Happy 96.6%
Calm 2.3%
Surprised 0.4%
Fear 0.2%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 60-70
Gender Male, 100%
Calm 66.9%
Happy 21.9%
Surprised 3.5%
Fear 3.4%
Angry 1.5%
Sad 1.2%
Disgusted 0.8%
Confused 0.8%

AWS Rekognition

Age 58-66
Gender Male, 100%
Happy 99.8%
Calm 0%
Angry 0%
Surprised 0%
Fear 0%
Sad 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 43-51
Gender Male, 91.5%
Calm 80%
Sad 11.6%
Fear 3.3%
Angry 1.5%
Surprised 1.2%
Happy 1%
Disgusted 0.8%
Confused 0.5%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 71
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Suit 97.8%
Tie 97.8%
Person 97.5%

Captions

Microsoft

Harry Lauter et al. wearing military uniforms posing for a photo 97.2%
Harry Lauter et al. posing for a photo 97.1%
Harry Lauter et al. in uniform posing for a photo 97%