Human Generated Data

Title

Untitled (bride and groom chatting with guests next to mermaid buffet platter)
Date

1949
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9296

Human Generated Data

Title

Untitled (bride and groom chatting with guests next to mermaid buffet platter)

People

Artist: Martin Schweig, American 20th century

Date

1949

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9296

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.2
Apparel 99.2
Person 99
Human 99
Person 98.7
Person 98.6
Person 95.3
Person 95.1
Person 95.1
Person 93.2
Suit 91.1
Coat 91.1
Overcoat 91.1
Sunglasses 89.7
Accessories 89.7
Accessory 89.7
Female 78.6
Furniture 77.5
Gown 74.3
Fashion 74.3
Dress 72
People 70.2
Photography 69.5
Photo 69.5
Face 69
Portrait 68.3
Tuxedo 68.1
Robe 67.4
Girl 63.8
Performer 63.7
Woman 58.3
Wedding 57.6
Doctor 57.5
Living Room 57
Room 57
Indoors 57
Clinic 56.3

Clarifai
created on 2023-10-27

people 99.7
group 99.5
child 97.9
woman 97
man 96.5
adult 94.4
monochrome 90.5
wear 90.1
group together 88.9
outfit 86.6
three 86.1
music 85.8
administration 85.6
several 85.5
medical practitioner 85.2
costume 83.8
uniform 83.5
actor 83.4
family 82.2
education 80.4

Imagga
created on 2022-01-23

salon 58
barbershop 43.6
senior 34.7
shop 33.8
man 31.6
home 30.3
male 29.1
people 29
hairdresser 28.2
mercantile establishment 26.7
indoors 26.3
person 25.3
smiling 23.1
couple 22.6
adult 21.1
room 20
happy 20
family 19.6
mature 19.5
sitting 18.9
lifestyle 18.1
men 18
happiness 18
place of business 17.8
women 16.6
elderly 16.3
violin 16
portrait 15.5
two 15.2
old 13.9
table 13.8
smile 13.5
bowed stringed instrument 13.2
together 13.1
cheerful 13
two people 12.6
mother 12.6
patient 12.5
stringed instrument 11.7
retired 11.6
to 11.5
office 11.2
musical instrument 11
indoor 10.9
aged 10.9
70s 10.8
chair 10.7
kitchen 10.7
care 10.7
interior 10.6
medical 10.6
retirement 10.6
talking 10.4
looking 10.4
handsome 9.8
health 9.7
business 9.7
businessman 9.7
older 9.7
group 9.7
standing 9.6
daughter 9.5
enjoying 9.5
togetherness 9.4
doctor 9.4
worker 9.4
casual 9.3
occupation 9.2
modern 9.1
establishment 8.9
working 8.8
nurse 8.7
love 8.7
hospital 8.6
attractive 8.4
inside 8.3
vintage 8.3
holding 8.2
retro 8.2
work 7.8
day 7.8
grandmother 7.8
face 7.8
discussion 7.8
married 7.7
drinking 7.6
husband 7.6
illness 7.6
wife 7.6
professional 7.6
clothing 7.3
alone 7.3
relaxing 7.3
dress 7.2
job 7.1

Google
created on 2022-01-23

Art 82.3
Snapshot 74.3
Vintage clothing 73.3
Event 71.8
Musical instrument 69.6
Room 69.3
Stock photography 63.9
History 59.6
Cooking 59.5
Monochrome photography 58
Health care provider 57.9
Folk instrument 57
Monochrome 56.9
Service 55
Guitar 55
Visual arts 53.9

Microsoft
created on 2022-01-23

wedding dress 96.3
person 95.5
text 94.9
bride 94.3
clothing 84.3
woman 82.2
dress 77
wedding 64.8
smile 61.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Female, 91.2%
Calm 66.9%
Confused 14.1%
Angry 8%
Surprised 5.4%
Sad 1.9%
Disgusted 1.4%
Happy 1.3%
Fear 1.2%

AWS Rekognition

Age 48-54
Gender Female, 88.9%
Happy 61.3%
Calm 30.1%
Surprised 4.3%
Sad 2%
Disgusted 0.8%
Confused 0.6%
Fear 0.5%
Angry 0.4%

AWS Rekognition

Age 45-53
Gender Female, 99.8%
Calm 90.9%
Happy 6.4%
Surprised 1.5%
Fear 0.3%
Disgusted 0.2%
Angry 0.2%
Sad 0.2%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Female, 95.1%
Happy 81.3%
Calm 7.1%
Surprised 6.9%
Angry 1.7%
Fear 1%
Sad 0.9%
Disgusted 0.7%
Confused 0.5%

AWS Rekognition

Age 37-45
Gender Male, 99.3%
Calm 99.5%
Sad 0.2%
Confused 0.1%
Happy 0%
Angry 0%
Disgusted 0%
Surprised 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Sunglasses 89.7%

Categories

Imagga

people portraits 80.1%
events parties 15%
interior objects 1.8%
food drinks 1.5%

Text analysis

Amazon

8
st st 8
KODVK-SEIA
st st

Google

KODVK-
KODVK-