Human Generated Data

Title

Untitled (five mothers posed with young children at outdoor table with birthday cake on top)

Date

1950-1955

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9474

Human Generated Data

Title

Untitled (five mothers posed with young children at outdoor table with birthday cake on top)

People

Artist: Martin Schweig, American 20th century

Date

1950-1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9474

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.3
Human 99.3
Person 99.1
Person 98.7
Clothing 98.2
Apparel 98.2
Person 97.3
Person 96.2
Person 96.1
Furniture 96.1
Person 95.9
Person 94.5
Meal 91.4
Food 91.4
Dress 89.9
Person 89.5
Female 87.9
People 84.6
Table 84
Person 83.5
Tabletop 82.5
Dining Table 81.9
Indoors 79.6
Plant 77.7
Face 77.2
Room 76.2
Dish 70
Gown 68
Fashion 68
Woman 67.4
Chair 67.4
Outdoors 66.8
Portrait 66.4
Photography 66.4
Photo 66.4
Robe 65.7
Girl 65.5
Icing 63.6
Dessert 63.6
Cake 63.6
Cream 63.6
Creme 63.6
Person 62.3
Nature 61.6
Flower 60.7
Blossom 60.7
Suit 60.1
Coat 60.1
Overcoat 60.1
Wedding 59.7
Art 57.7
Wedding Gown 57.1
Drawing 55.4

Clarifai
created on 2023-10-26

people 99.9
group 99.4
woman 97.9
adult 97.4
child 96.9
man 96.7
group together 95.1
monochrome 95.1
leader 93.3
many 90.8
administration 90.5
several 88.9
war 88.9
sit 85.5
room 84.2
family 84
boy 83.8
education 83.6
recreation 82.5
furniture 81.6

Imagga
created on 2022-01-23

adult 27.1
teacher 26.8
people 26.2
person 25.8
happy 22.5
negative 22.4
bride 22.3
wedding 22
dress 21.7
couple 20
educator 19.6
film 18.9
man 18.9
love 18.9
lifestyle 18.8
women 17.4
attractive 16.1
smiling 15.9
married 15.3
smile 14.9
happiness 14.9
male 14.2
sitting 13.7
professional 13.4
groom 13.4
pretty 13.3
photographic paper 13.1
portrait 12.9
school 12.8
outdoors 12.7
marriage 12.3
indoors 12.3
indoor 11.9
romantic 11.6
bouquet 11.3
senior 11.2
two 11
room 10.4
men 10.3
model 10.1
face 9.9
blackboard 9.8
lady 9.7
home 9.6
flowers 9.6
day 9.4
classroom 9.3
joy 9.2
fun 9
cheerful 8.9
photographic equipment 8.8
together 8.8
standing 8.7
luxury 8.6
wife 8.5
old 8.4
fashion 8.3
holding 8.2
human 8.2
vacation 8.2
child 8.2
water 8
celebration 8
hair 7.9
gown 7.8
health 7.6
performer 7.6
clothes 7.5
leisure 7.5
style 7.4
event 7.4
relaxing 7.3
black 7.2
active 7.2
structure 7.1
summer 7.1
travel 7
building 7
modern 7

Google
created on 2022-01-23

Black 89.5
Style 83.8
Black-and-white 81.9
Font 80.7
Art 77.6
Window 75.5
Chair 73.6
Monochrome 73.2
Event 73.1
Monochrome photography 71.8
Rectangle 70.5
Table 70.1
Vintage clothing 69.8
Room 69.3
Suit 67.6
History 67.4
Visual arts 67.1
Stock photography 62.6
Illustration 61.1
Picture frame 59.3

Microsoft
created on 2022-01-23

text 96.2
clothing 94.1
drawing 91
person 88.2
window 86.6
cartoon 81
man 76.4
bottle 74.9
black and white 56.4
posing 36.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Female, 75.7%
Happy 67.7%
Confused 18.4%
Sad 3.6%
Calm 3.5%
Surprised 2.3%
Disgusted 2.2%
Fear 1.3%
Angry 1.1%

AWS Rekognition

Age 27-37
Gender Female, 58.1%
Sad 71.5%
Calm 10.6%
Happy 6.7%
Surprised 3.8%
Confused 2.7%
Fear 2.2%
Disgusted 1.5%
Angry 1%

AWS Rekognition

Age 23-31
Gender Male, 99.4%
Surprised 95.1%
Happy 2.3%
Fear 1.6%
Angry 0.3%
Calm 0.2%
Sad 0.2%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Male, 96.2%
Happy 79.1%
Calm 7.3%
Sad 5.5%
Surprised 3.4%
Angry 2%
Fear 1.6%
Disgusted 0.7%
Confused 0.4%

AWS Rekognition

Age 35-43
Gender Female, 71.4%
Happy 91.8%
Surprised 4.7%
Calm 1.4%
Sad 0.9%
Confused 0.5%
Disgusted 0.5%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 36-44
Gender Male, 87%
Happy 91.2%
Calm 6.3%
Surprised 1.4%
Sad 0.4%
Angry 0.2%
Fear 0.2%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Surprised 46.5%
Calm 28.3%
Confused 9.7%
Happy 4.8%
Sad 4.7%
Disgusted 3.2%
Fear 1.6%
Angry 1.1%

AWS Rekognition

Age 25-35
Gender Male, 95.3%
Surprised 69.2%
Angry 16.5%
Sad 4.5%
Fear 3.1%
Happy 2%
Confused 1.7%
Calm 1.6%
Disgusted 1.5%

AWS Rekognition

Age 18-26
Gender Male, 55.8%
Calm 98.6%
Sad 0.6%
Confused 0.5%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 78.3%
Calm 47.5%
Sad 46.7%
Happy 2.2%
Angry 1.9%
Confused 0.6%
Surprised 0.5%
Disgusted 0.3%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.3%
Person 99.1%
Person 98.7%
Person 97.3%
Person 96.2%
Person 96.1%
Person 95.9%
Person 94.5%
Person 89.5%
Person 83.5%
Person 62.3%

Text analysis

Amazon

KODAKS.VEELA
КУОНИТА
CLUB
ases
8 11 ases
8 11
Had

Google

3 S C HAPY
3
S
C
HAPY