Human Generated Data

Title

Untitled (young man and woman standing by young girl at buffet table for Masonic ceremony)
Date

1951
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9373

Human Generated Data

Title

Untitled (young man and woman standing by young girl at buffet table for Masonic ceremony)

People

Artist: Martin Schweig, American 20th century

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.7
Apparel 99.7
Person 99.2
Human 99.2
Overcoat 98.8
Suit 98.8
Coat 98.8
Person 97.7
Dress 97.6
Tie 97.4
Accessory 97.4
Accessories 97.4
Person 97.3
Female 96.2
Person 95.5
Person 95.4
Face 91
Person 90.4
Kid 89.7
Teen 89.7
Child 89.7
Woman 89.7
Blonde 89.7
Girl 89.7
Gown 85.8
Fashion 85.8
Wedding 84
Robe 83.9
Bridegroom 82.1
Tuxedo 80.6
Chair 77.9
Furniture 77.9
Food 76
Meal 76
Leisure Activities 75.4
Collage 74.4
Poster 74.4
Advertisement 74.4
Musician 74.2
Musical Instrument 74.2
Person 72
Wedding Gown 71.2
Photo 70.3
Photography 70.3
Portrait 69.5
Dish 69.3
Person 67.3
Plant 67.2
Performer 67.2
People 66.8
Outdoors 62.5
Table 61.8
Man 58.9
Head 58.6
Blossom 58
Flower 58
Bride 58
Music Band 57.7
Evening Dress 56
Costume 55.4
Person 53.6

Imagga
created on 2022-01-23

people 30.7
male 29.1
man 28.9
adult 24.9
person 24.9
business 21.2
musical instrument 20.4
businessman 20.3
percussion instrument 19.5
steel drum 18.7
men 17.2
indoors 15.8
happy 15.7
clothing 15.6
professional 15
room 14.9
portrait 14.9
corporate 14.6
worker 14
couple 13.9
office 13.7
sitting 13.7
day 13.3
job 13.3
smiling 13
lifestyle 13
group 12.9
home 12.8
smile 12.1
indoor 11.9
women 11.9
kin 11.7
adults 11.4
modern 11.2
bride 10.7
interior 10.6
teacher 10.5
businesspeople 10.4
table 10.4
clothes 10.3
work 10.2
happiness 10.2
casual 10.2
color 10
fashion 9.8
life 9.7
colleagues 9.7
window 9.3
clinic 9.2
suit 9
family 8.9
associates 8.8
medical 8.8
looking 8.8
black 8.4
board 8.2
businesswoman 8.2
dress 8.1
team 8.1
hairdresser 8.1
handsome 8
together 7.9
education 7.8
executive 7.7
30s 7.7
two 7.6
elegance 7.6
meeting 7.5
laptop 7.4
wedding 7.4
20s 7.3
cheerful 7.3
lady 7.3
new 7.3
computer 7.3
groom 7.2
kitchen 7.2
bright 7.1

Google
created on 2022-01-23

Hat 89.3
Coat 87.5
Black-and-white 84.6
Picture frame 84.3
Style 83.9
Art 81.6
Adaptation 79.4
Plant 78.9
Suit 78.3
Monochrome photography 77.3
Monochrome 72.8
Event 72
Room 68.9
Font 65.3
Vintage clothing 64.3
Stock photography 62.4
Visual arts 60.5
Illustration 60.5
History 59.1
Sun hat 58.2

Microsoft
created on 2022-01-23

person 98.9
wall 96.4
text 95.8
musical instrument 95.1
clothing 92.2
guitar 87.1
standing 80.3
concert 70.9

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Female, 72.7%
Happy 92.3%
Calm 6.8%
Surprised 0.4%
Sad 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 41-49
Gender Male, 98.9%
Sad 56.7%
Calm 32.7%
Surprised 2.3%
Angry 2.2%
Confused 2%
Happy 1.8%
Disgusted 1.7%
Fear 0.6%

AWS Rekognition

Age 31-41
Gender Male, 99.8%
Surprised 51.4%
Confused 21.7%
Calm 14.4%
Happy 3.7%
Disgusted 3.1%
Fear 2.9%
Sad 2.1%
Angry 0.8%

AWS Rekognition

Age 39-47
Gender Male, 96.8%
Calm 96.2%
Sad 1.5%
Angry 0.8%
Disgusted 0.5%
Surprised 0.5%
Confused 0.3%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 54-64
Gender Male, 93.9%
Calm 99.9%
Sad 0%
Confused 0%
Happy 0%
Disgusted 0%
Angry 0%
Surprised 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.2%
Tie 97.4%

Captions

Microsoft

a group of people standing in front of a cake 95.2%
a man and a woman standing in front of a cake 90.3%
a person standing in front of a cake 90.2%

Text analysis

Amazon

BEAA
ة BEAA
ة

Google

161
161