Human Generated Data

Title

Untitled (three men standing and four women seated outside house)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6986

Human Generated Data

Title

Untitled (three men standing and four women seated outside house)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.9
Human 98.9
Person 98.9
Person 98.8
Suit 98.7
Overcoat 98.7
Apparel 98.7
Coat 98.7
Clothing 98.7
Suit 97.4
Person 97.3
People 96.9
Person 96.2
Suit 95.4
Family 92.9
Person 92.8
Person 90.8
Accessory 88
Tie 88
Accessories 88
Tie 86
Tie 64.5
Sitting 59.1

Imagga
created on 2022-01-23

kin 100
businessman 55.6
man 51.1
businesswoman 50
business 49.2
team 48.4
male 44.1
businesspeople 43.7
office 41.8
group 41.1
corporate 36.9
colleagues 36.9
meeting 35.8
teamwork 35.2
people 33.5
smiling 30.4
men 28.3
happy 28.2
businessmen 27.3
adult 27.2
executive 27
partnership 25
coworkers 23.6
partners 23.3
30s 23.1
success 22.5
person 22.5
job 22.1
20s 22
confident 21.8
professional 19.6
successful 19.2
associates 18.7
indoors 18.5
together 18.4
staff 18.2
suit 18.2
work 18.1
worker 17.8
cooperation 17.4
standing 17.4
corporation 17.4
leadership 17.3
manager 16.8
businesswomen 16.7
40s 15.6
employee 15.4
career 15.1
working 15
portrait 14.9
company 14.9
mature 14.9
discussing 14.7
indoor 14.6
discussion 14.6
partner 14.5
lifestyle 14.5
four 14.4
communication 14.3
horizontal 14.2
groom 14.2
25 30 years 13.7
looking 13.6
mid adult 13.5
couple 13.1
cheerful 13
camera 12.9
employment 12.6
handsome 12.5
smile 12.1
crew 11.8
agreement 11.7
busy 11.6
talking 11.4
desk 11.3
senior 11.2
attractive 11.2
boardroom 10.9
collaboration 10.8
diverse 10.8
conference 10.8
colleague 10.7
jacket 10.6
diversity 10.6
boss 10.5
workplace 10.5
women 10.3
happiness 10.2
laptop 10
family 9.8
deal 9.7
computer 9.6
confidence 9.6
formal 9.6
tie 9.5
females 9.5
sitting 9.4
casual 9.3
occupation 9.2
color 8.9
business people 8.9
30 35 years 8.8
forties 8.8
good mood 8.8
handshake 8.8
thirties 8.8
mother 8.7
holding 8.3
appointment 7.8
brunette 7.8
contract 7.8
table 7.8
doctor 7.5
bow tie 7.4
necktie 7.2
building 7.1
face 7.1

Google
created on 2022-01-23

Photograph 94.4
Black 89.6
Coat 89.4
Smile 84.2
Suit 80.8
Vintage clothing 76.1
Snapshot 74.3
Event 74
Classic 72.2
Blazer 71.9
Monochrome 69.8
Team 69.5
Tie 64.9
History 64.8
Formal wear 62
Stock photography 61.9
Monochrome photography 61.7
Sitting 56.8
Retro style 56
Family 55.6

Microsoft
created on 2022-01-23

person 99.9
clothing 98.2
outdoor 97
smile 96.3
posing 96
suit 94.7
man 92.7
group 92.4
text 89.4
military uniform 87.2
human face 86.4
old 83.1
people 78.5
team 26.5
necktie 15.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-53
Gender Male, 100%
Calm 86.7%
Angry 8.3%
Confused 2.7%
Happy 0.9%
Sad 0.4%
Disgusted 0.4%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 54-62
Gender Female, 99.6%
Calm 77.6%
Confused 17.6%
Happy 1.9%
Disgusted 0.6%
Fear 0.6%
Angry 0.6%
Surprised 0.5%
Sad 0.5%

AWS Rekognition

Age 51-59
Gender Male, 100%
Happy 98.4%
Confused 0.5%
Angry 0.4%
Disgusted 0.2%
Calm 0.2%
Surprised 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 41-49
Gender Female, 99.6%
Happy 78.1%
Calm 9.4%
Confused 7%
Angry 1.9%
Surprised 1.5%
Fear 0.8%
Disgusted 0.8%
Sad 0.5%

AWS Rekognition

Age 54-64
Gender Female, 100%
Calm 94.4%
Happy 4.1%
Disgusted 0.5%
Confused 0.4%
Sad 0.2%
Surprised 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 51-59
Gender Male, 99.8%
Calm 52.4%
Happy 40.8%
Confused 2.2%
Sad 1.5%
Disgusted 1.1%
Angry 0.7%
Fear 0.7%
Surprised 0.5%

AWS Rekognition

Age 66-76
Gender Male, 99.9%
Calm 98.1%
Angry 0.5%
Surprised 0.3%
Happy 0.3%
Disgusted 0.3%
Sad 0.2%
Fear 0.2%
Confused 0.1%

Microsoft Cognitive Services

Age 68
Gender Female

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 59
Gender Female

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 47
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Suit 98.7%
Tie 88%

Captions

Microsoft

Fred Allen et al. posing for a photo 99.1%
a vintage photo of Fred Allen et al. posing for the camera 98.5%
Fred Allen et al. posing for the camera 98.4%