Human Generated Data

Title

Untitled (group portrait, Manchester, New Hampshire)
Date

1937, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.27

Human Generated Data

Title

Untitled (group portrait, Manchester, New Hampshire)

People

Artist: Durette Studio, American 20th century

Date

1937, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.5
Human 99.5
Person 99.5
Clothing 99.1
Apparel 99.1
Person 98.9
Person 96.8
Person 94.7
People 94.7
Footwear 93
Shoe 93
Person 91.5
Person 90.3
Family 89.4
Suit 87
Overcoat 87
Coat 87
Accessory 77.3
Tie 77.3
Accessories 77.3
Shoe 64.4
Costume 61.5
Shoe 59.9
Floor 59
Furniture 57.7
Flooring 55.6
Shoe 51.4

Imagga
created on 2021-12-14

kin 51.3
man 42.3
businessman 39.7
male 39.7
business 39.5
people 37.4
group 33
men 30
office 28.1
adult 27.3
person 26.6
team 26
happy 25.7
colleagues 25.2
businesspeople 24.7
executive 24.6
businesswoman 24.5
professional 24.5
standing 24.3
corporate 24
work 22.7
teamwork 22.2
couple 21.8
meeting 21.7
smiling 19.5
indoors 19.3
30s 19.2
businessmen 18.5
mature 17.7
job 16.8
together 16.6
20s 16.5
senior 15.9
women 15.8
40s 15.6
cheerful 15.4
success 15.3
portrait 14.9
suit 14.8
staff 14.5
secretary 13.8
associates 13.8
partners 13.6
corporation 13.5
adults 13.2
smile 12.8
home 12.8
handsome 12.5
confident 11.8
coworkers 11.8
happiness 11.7
manager 11.2
communication 10.9
student 10.4
sitting 10.3
casual 10.2
jacket 10
businesswomen 9.8
attractive 9.8
lady 9.7
mid adult 9.6
clothing 9.6
grandfather 9.6
partnership 9.6
looking 9.6
elderly 9.6
confidence 9.6
career 9.5
day 9.4
lifestyle 9.4
foreman 9.3
face 9.2
friendly 9.1
worker 8.9
family 8.9
forties 8.8
diverse 8.8
colleague 8.8
workers 8.7
love 8.7
four 8.6
tie 8.5
black 8.5
metropolitan 8.4
horizontal 8.4
company 8.4
old 8.4
color 8.3
inside 8.3
aged 8.1
working 8
building 7.9
business people 7.9
25 30 years 7.8
handshake 7.8
60s 7.8
modern 7.7
diversity 7.7
boss 7.6
talking 7.6
hand 7.6
females 7.6
desk 7.6
friends 7.5
camera 7.4
life 7.3
successful 7.3
indoor 7.3
dress 7.2
medical 7.1
planner 7

Google
created on 2021-12-14

Footwear 98.5
Shoe 96.3
Coat 92.1
Standing 86.4
Picture frame 85.3
Dress 85.1
Chair 78.6
Vintage clothing 75.9
Classic 74.3
Suit 73.8
Event 73.5
History 65.8
Family reunion 64.7
Boot 63.5
Stock photography 62.9
Monochrome photography 62.1
Room 58.8
Monochrome 58.5
Lap 56.5
Retro style 55.9

Microsoft
created on 2021-12-14

person 100
clothing 98.1
standing 95.7
posing 95.4
group 93.2
suit 91.3
text 91
smile 89.4
woman 89
man 88.5
footwear 79.9
people 69.2
dress 61.9
old 48.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 52-70
Gender Male, 97.9%
Calm 71.8%
Sad 12.5%
Angry 11.7%
Confused 1.5%
Surprised 1%
Happy 0.7%
Fear 0.6%
Disgusted 0.2%

AWS Rekognition

Age 51-69
Gender Female, 98.6%
Sad 47.8%
Calm 27.8%
Angry 13.3%
Confused 4.6%
Surprised 2.6%
Fear 1.6%
Disgusted 1.5%
Happy 0.8%

AWS Rekognition

Age 51-69
Gender Male, 76.6%
Calm 94.5%
Happy 2.2%
Confused 1.1%
Sad 0.9%
Angry 0.8%
Surprised 0.3%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 48-66
Gender Female, 54.8%
Calm 58.5%
Happy 39.1%
Confused 1.1%
Sad 0.5%
Disgusted 0.3%
Surprised 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 55-73
Gender Male, 98.7%
Calm 91%
Confused 4.2%
Surprised 1.8%
Sad 1.3%
Fear 0.9%
Happy 0.6%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 68-82
Gender Male, 98%
Calm 79.8%
Fear 8.5%
Surprised 5.8%
Happy 2.8%
Sad 1.2%
Angry 1%
Confused 0.7%
Disgusted 0.2%

AWS Rekognition

Age 58-76
Gender Female, 78.3%
Calm 94.5%
Angry 2.2%
Sad 1.4%
Happy 0.8%
Confused 0.6%
Surprised 0.3%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 62-78
Gender Male, 93.7%
Calm 74.6%
Happy 18.7%
Sad 2.8%
Disgusted 1.7%
Angry 0.9%
Confused 0.6%
Surprised 0.5%
Fear 0.2%

Microsoft Cognitive Services

Age 67
Gender Male

Microsoft Cognitive Services

Age 66
Gender Female

Microsoft Cognitive Services

Age 68
Gender Female

Microsoft Cognitive Services

Age 65
Gender Female

Microsoft Cognitive Services

Age 68
Gender Female

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 65
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 93%
Suit 87%
Tie 77.3%

Captions

Microsoft

a group of people posing for a photo 99.1%
a group of people posing for a picture 99%
a group of people posing for the camera 98.9%

Text analysis

Amazon

62%
121
1937
George
New
Hampshi
Durette
26
re
George Durette Studio
200
Manchester, New Hampshi re
Studio
Manchester,

Google

121 62% George Durette Studio Manchester, New Hampshire 1937
121
George
62%
1937
Studio
Durette
Manchester,
New
Hampshire