Human Generated Data

Title

Untitled (family group at wedding reception, Brookline, MA)
Date

1940, printed later
People

Artist: Samuel Cooper, American active 1950s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.972

Human Generated Data

Title

Untitled (family group at wedding reception, Brookline, MA)

People

Artist: Samuel Cooper, American active 1950s

Date

1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Tie 99.5
Accessories 99.5
Accessory 99.5
Person 99.4
Human 99.4
Person 99.2
Clothing 96.7
Apparel 96.7
Suit 96.6
Coat 96.6
Overcoat 96.6
Person 94.3
People 83.6
Face 77.6
Female 77
Crowd 74.1
Plant 66
Sleeve 64.6
Couch 62.6
Furniture 62.6
Girl 61.5
Flower 61.5
Blossom 61.5
Woman 59.1
Funeral 55.8

Imagga
created on 2021-12-14

bow tie 56.5
man 51.1
businessman 46.8
necktie 44.7
business 40.1
male 38.3
person 37.2
suit 34.4
office 32.9
professional 32.4
people 32.4
corporate 31.8
adult 30.2
executive 27.5
businesspeople 25.6
businesswoman 25.5
portrait 23.9
job 23.9
garment 23.5
work 22.8
meeting 20.7
happy 20.7
confident 20
clothing 19.9
team 19.7
standing 18.3
tie 18
handsome 17.8
group 17.7
success 16.9
successful 16.5
career 16.1
smiling 15.9
teamwork 15.8
colleagues 15.5
mug shot 15.5
men 15.5
partner 15.5
expression 15.4
formal 15.3
communication 14.3
holding 14
couple 13.9
worker 13.9
confidence 13.4
modern 13.3
jacket 13.3
attractive 13.3
cheerful 13
occupation 12.8
smile 12.8
looking 12.8
indoor 12.8
golfer 12.6
groom 12.5
partnership 12.5
black 12
photograph 12
employee 11.8
businessmen 11.7
partners 11.7
face 11.4
computer 11.2
manager 11.2
20s 11
corporation 10.6
30s 10.6
leadership 10.6
guy 10.5
workplace 10.5
desk 10.4
company 10.2
lifestyle 10.1
alone 10
player 9.7
staff 9.7
representation 9.6
boss 9.6
color 9.5
smart 9.4
happiness 9.4
mature 9.3
friendly 9.1
laptop 9.1
working 8.8
indoors 8.8
together 8.8
building 8.7
employment 8.7
love 8.7
mid adult 8.7
busy 8.7
collar 8.6
sitting 8.6
talking 8.6
shirt 8.5
casual 8.5
contemporary 8.5
human 8.2
lady 8.1
25 30 years 7.8
elegant 7.7
contestant 7.6
one 7.5
presentation 7.4
style 7.4
wedding 7.4
adolescent 7.3
family 7.1

Google
created on 2021-12-14

Photograph 94.2
Coat 92.7
Style 83.8
Suit 83.1
Black-and-white 81.9
Picture frame 78.6
Formal wear 76.1
Vintage clothing 76
Classic 74.5
Snapshot 74.3
Monochrome photography 73.8
Event 73.6
Monochrome 72.9
Tie 71.4
Font 70.3
Room 67.7
History 64.9
Stock photography 63.5
Photo caption 61
Art 60.9

Microsoft
created on 2021-12-14

person 99.2
wall 98.3
posing 98.1
standing 92.1
smile 89.1
clothing 89
man 87.7
text 85.5
suit 84.1
human face 78.7
drawing 78.2
people 67
sketch 64.5
old 53.9
picture frame 10.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 53-71
Gender Female, 99.8%
Calm 79.7%
Happy 6.1%
Sad 5%
Fear 3.9%
Surprised 1.8%
Confused 1.6%
Angry 1.1%
Disgusted 0.9%

AWS Rekognition

Age 42-60
Gender Male, 99.9%
Calm 79.8%
Fear 13.3%
Angry 2.8%
Surprised 2%
Confused 0.7%
Happy 0.5%
Disgusted 0.5%
Sad 0.4%

AWS Rekognition

Age 73-87
Gender Female, 99.7%
Calm 51.9%
Happy 42%
Sad 2.1%
Surprised 1.6%
Angry 1%
Confused 0.7%
Disgusted 0.4%
Fear 0.3%

Microsoft Cognitive Services

Age 53
Gender Male

Microsoft Cognitive Services

Age 70
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.5%
Person 99.4%
Suit 96.6%

Captions

Microsoft

a group of people posing for a photo 99%
a person standing in front of a group of people posing for a photo 96.9%
a group of people posing for the camera 96.8%

Text analysis

Amazon

Cooper
46%
54
Samuel Cooper Studio
Studio
1940
Samuel
MA
P66
Brookline MA
Brookline
EK

Google

AA 54 46% P66 Samuel Cooper Studio Brookline, MA 1940
AA
54
46%
P66
Samuel
Cooper
Studio
Brookline,
MA
1940