Human Generated Data

Title

Untitled (man with fake moustache dancing with young woman at New Year's party)

Date

1952

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9413

Human Generated Data

Title

Untitled (man with fake moustache dancing with young woman at New Year's party)

People

Artist: Martin Schweig, American 20th century

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 100
Apparel 100
Hat 99.8
Person 99.3
Human 99.3
Hat 98.5
Person 98.4
Person 98
Person 97.9
Person 96.7
Person 90.7
Fashion 90.2
Gown 90.2
Dress 89.6
Robe 88.4
Suit 86.1
Coat 86.1
Overcoat 86.1
Female 82.3
Wedding 82
Accessory 78
Sunglasses 78
Accessories 78
Woman 74.7
Wedding Gown 73.2
Sun Hat 69.8
Cowboy Hat 63.8
Bridegroom 62.6
Photo 62.4
Photography 62.4
Bride 59
Person 49.7

Imagga
created on 2022-01-23

man 30.2
people 29.6
person 29.2
male 25.5
adult 22.3
business 18.8
happy 18.8
home 18.3
men 18
indoors 17.6
couple 16.5
office 16.4
portrait 16.2
professional 15.4
women 13.4
room 13.4
happiness 13.3
senior 13.1
mature 13
indoor 12.8
modern 12.6
desk 12.4
group 12.1
interior 11.5
black 11.4
clothing 11.4
smile 11.4
casual 11
smiling 10.8
bride 10.8
suit 10.8
family 10.7
businessman 10.6
human 10.5
table 10.5
old 10.4
adults 10.4
looking 10.4
love 10.3
life 10.2
lifestyle 10.1
worker 9.9
kitchen 9.8
education 9.5
corporate 9.4
sitting 9.4
work 9.4
two 9.3
face 9.2
nurse 9.2
dress 9
team 9
cheerful 8.9
handsome 8.9
together 8.8
mother 8.7
tie 8.5
meeting 8.5
window 8.4
elegance 8.4
house 8.4
musical instrument 8.2
lady 8.1
light 8
communication 7.6
fashion 7.5
fun 7.5
leisure 7.5
wedding 7.4
kin 7.3
board 7.2
job 7.1

Google
created on 2022-01-23

Photograph 94.1
Hat 92.2
Black 89.7
Fedora 88.6
Black-and-white 86.4
Sun hat 85.4
Gesture 85.3
Style 84
Art 83.5
Headgear 82.6
Cap 79.6
Monochrome photography 77.1
Monochrome 75.7
Fashion design 74.8
Snapshot 74.3
Vintage clothing 73.3
Event 71.5
Font 69.9
Visual arts 67.4
Costume hat 66.5

Microsoft
created on 2022-01-23

text 98.8
clothing 92.2
person 92.2
posing 86.5
standing 83.2
drawing 81.6
old 79.5
man 74.4
black and white 52.6
vintage 26.5

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 93.7%
Surprised 93.6%
Confused 2.5%
Calm 1.2%
Sad 0.9%
Happy 0.6%
Fear 0.6%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 38-46
Gender Female, 74.7%
Calm 99.5%
Sad 0.2%
Surprised 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 22-30
Gender Male, 99.5%
Calm 46%
Sad 32.4%
Happy 10.2%
Surprised 3.9%
Confused 2.9%
Fear 2.3%
Disgusted 1.3%
Angry 1.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.8%
Person 99.3%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 94.8%
a vintage photo of a group of people posing for a picture 94.7%
a group of people posing for a photo 94.5%

Text analysis

Amazon

80A
KODAK-
**8
with

Google

te8 t寸
t
te8