Human Generated Data

Title

Untitled (wedding party)

Date

1910s

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.840

Human Generated Data

Title

Untitled (wedding party)

People

Artist: Martin Schweig, American 20th century

Date

1910s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.840

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 99.9
Apparel 99.9
Person 99.5
Human 99.5
Person 99.4
Person 98.9
Person 98.7
Bridesmaid 98.4
Wedding 98.4
Person 97.7
Person 97.4
Person 96.7
Person 96.5
Person 96.4
Robe 94
Fashion 94
Person 91.7
Gown 91.4
Painting 85.2
Art 85.2
Person 83.7
Person 83.6
Person 80
Bride 79.1
Wedding Gown 79.1
Plant 76.9
Flower 76.7
Blossom 76.7
Flower Bouquet 74.9
Flower Arrangement 74.9
Person 59.5

Clarifai
created on 2023-10-25

people 100
group 99.9
many 99.4
child 98.7
wear 98.7
wedding 98.3
administration 98.2
group together 98.2
several 96.3
flower arrangement 96.2
adult 96
portrait 93.5
son 93
woman 92.8
facial expression 91.9
man 91.8
music 91.7
royalty 90.7
family 90.4
dress 90.3

Imagga
created on 2022-01-08

kin 100
couple 43.5
groom 38.8
bride 36.4
wedding 31.3
people 31.2
happiness 30.5
man 29.5
love 29.2
married 25.9
dress 25.3
happy 25.1
male 23.4
person 22.7
portrait 22.6
bouquet 22.6
senior 22.5
adult 21.6
family 21.3
two 21.2
husband 20.2
marriage 19
wife 18
together 17.5
smiling 17.4
old 16
mother 15.9
women 15.8
flowers 15.6
romance 15.2
home 14.4
smile 14.2
outdoors 13.4
day 13.3
men 12.9
veil 12.7
daughter 12.4
cheerful 12.2
fashion 12.1
child 12
wed 11.8
ceremony 11.6
human 11.2
relationship 11.2
mature 11.1
gown 10.7
world 10.7
romantic 10.7
elderly 10.5
celebration 10.4
summer 10.3
joy 10
father 10
flower 10
aged 10
outdoor 9.9
bridal 9.7
face 9.2
girls 9.1
park 9.1
new 8.9
matrimony 8.9
affection 8.7
lifestyle 8.7
elegance 8.4
parent 8.4
fan 8.3
wedded 7.9
cute 7.9
tenderness 7.8
retired 7.8
engagement 7.7
attractive 7.7
tender 7.7
retirement 7.7
loving 7.6
statue 7.6
hand 7.6
pair 7.6
friends 7.5
rose 7.5
fun 7.5
holding 7.4
care 7.4
lady 7.3
holiday 7.2
indoors 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 98.3
posing 97.9
wedding dress 95.8
dress 94
bride 93.4
clothing 92.2
woman 91
old 85.3
person 85.1
standing 84.5
group 83.7
flower 83.2
wedding 71.5
man 58.8
team 28.3
clothes 18.5
crowd 0.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 99.8%
Surprised 0.1%
Happy 0.1%
Confused 0%
Sad 0%
Angry 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 27-37
Gender Male, 99.3%
Calm 99.3%
Sad 0.2%
Surprised 0.1%
Confused 0.1%
Happy 0.1%
Angry 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 98.5%
Confused 0.8%
Surprised 0.2%
Angry 0.1%
Fear 0.1%
Sad 0.1%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 13-21
Gender Male, 89.6%
Calm 99.9%
Sad 0%
Disgusted 0%
Surprised 0%
Confused 0%
Angry 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Calm 98.1%
Confused 0.6%
Sad 0.5%
Surprised 0.3%
Happy 0.2%
Angry 0.2%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 100%
Confused 0%
Sad 0%
Surprised 0%
Happy 0%
Fear 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Female, 99.6%
Calm 98.9%
Sad 0.8%
Confused 0.1%
Surprised 0.1%
Angry 0%
Disgusted 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 96.5%
Surprised 1.2%
Happy 0.8%
Confused 0.7%
Angry 0.4%
Fear 0.2%
Sad 0.2%
Disgusted 0.1%

AWS Rekognition

Age 16-22
Gender Male, 100%
Calm 99.1%
Angry 0.2%
Sad 0.2%
Happy 0.2%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 93.3%
Surprised 2.2%
Angry 1.4%
Confused 1.1%
Happy 0.8%
Sad 0.6%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 16-22
Gender Female, 90.6%
Calm 100%
Confused 0%
Sad 0%
Happy 0%
Disgusted 0%
Angry 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 97.9%
Sad 0.6%
Disgusted 0.5%
Angry 0.3%
Surprised 0.2%
Fear 0.2%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 14-22
Gender Male, 100%
Happy 80.1%
Calm 17.9%
Sad 0.6%
Fear 0.4%
Angry 0.3%
Confused 0.3%
Surprised 0.2%
Disgusted 0.1%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 99.9%
Surprised 0%
Confused 0%
Happy 0%
Angry 0%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 16-22
Gender Male, 59%
Calm 95.4%
Confused 3.1%
Sad 0.7%
Surprised 0.3%
Angry 0.3%
Happy 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 16-22
Gender Male, 88.5%
Calm 99.9%
Sad 0%
Confused 0%
Happy 0%
Angry 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 22-30
Gender Female, 99.9%
Happy 95.1%
Calm 1.7%
Sad 0.9%
Fear 0.7%
Surprised 0.6%
Confused 0.5%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 13-21
Gender Female, 99%
Calm 87.8%
Confused 5.1%
Sad 4.1%
Fear 1.4%
Surprised 0.5%
Disgusted 0.3%
Angry 0.3%
Happy 0.3%

AWS Rekognition

Age 16-22
Gender Female, 99.1%
Calm 99.7%
Sad 0.1%
Confused 0.1%
Surprised 0%
Angry 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 14-22
Gender Male, 98.4%
Calm 70.6%
Sad 10.4%
Happy 7.1%
Surprised 3.3%
Fear 2.8%
Angry 2.6%
Disgusted 2%
Confused 1.1%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 85.2%

Text analysis

Amazon

SAHWEIG
ST. Lovis

Google

SH WEIa ST. LouN
SH
WEIa
ST.
LouN