Human Generated Data

Title

Untitled (two photographs: group portrait of nineteen member family posed in front of fireplace; double portrait of baby boy and baby girl sitting in large chair)
Date

1930-1945, printed later
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10281

Human Generated Data

Title

Untitled (two photographs: group portrait of nineteen member family posed in front of fireplace; double portrait of baby boy and baby girl sitting in large chair)

People

Artist: Martin Schweig, American 20th century

Date

1930-1945, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10281

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.6
Human 99.6
Person 99.4
Person 99.3
Person 98.5
Person 97.2
Collage 97.1
Advertisement 97.1
Person 96.8
Person 96.5
Person 93.4
Person 92.7
Accessories 92.2
Tie 92.2
Accessory 92.2
Person 90.8
Person 88
Person 86.2
Furniture 85.6
Person 76.3
Figurine 74.6
Baby 66.6
Person 65
Person 60.9
Newborn 57.6
Person 53.8
Poster 52.8

Clarifai
created on 2019-11-16

people 100
group 99.8
adult 99.5
furniture 99.3
many 99.2
woman 98.5
child 98.5
seat 97.7
portrait 97.4
leader 97.1
group together 97
sit 97
facial expression 96.8
actress 96.4
wear 96.3
offspring 96.2
man 95.6
outfit 94.6
several 94.5
administration 94.3

Imagga
created on 2019-11-16

child 18.8
happy 17.5
window 17.1
furniture 16.7
people 16.7
black 16.3
portrait 15.5
face 14.9
dress 13.5
smile 13.5
family 13.3
doll 13.3
person 13.2
cute 12.9
plaything 12.6
adult 12.3
love 11.8
happiness 11.7
vintage 11.7
design 11.4
fashion 11.3
boy 11.3
smiling 10.8
man 10.7
case 10.6
bride 10.5
shop 10.5
sexy 10.4
hair 10.3
expression 10.2
furnishing 10
toyshop 10
color 10
kin 9.9
pretty 9.8
style 9.6
frame 9.6
flowers 9.6
container 9.5
women 9.5
holiday 9.3
clothing 9.3
art 9.1
kid 8.9
office 8.8
china cabinet 8.7
couple 8.7
cabinet 8.6
male 8.5
wedding 8.3
decoration 8.2
one 8.2
hat 8.2
girls 8.2
refrigerator 8.2
lady 8.1
new 8.1
home 8
colorful 7.9
model 7.8
eyes 7.7
party 7.7
toy 7.7
old 7.7
mercantile establishment 7.6
elegance 7.6
human 7.5
children 7.3
celebration 7.2
religion 7.2
childhood 7.2
interior 7.1
framework 7

Google
created on 2019-11-16

Photograph 96.9
Photographic paper 87.8
Snapshot 84.5
Picture frame 79.2
Black-and-white 74.4
Photography 73.8
Room 71.4
Art 70.9
Photograph album 67.8
Collection 54
Collage 53.6
Interior design 51.5

Microsoft
created on 2019-11-16

clothing 98.3
person 97.8
text 92.4
human face 91.1
baby 79.3
gallery 74.6
white 70.5
black and white 69.7
posing 68.1
man 66.5
woman 59.7
toddler 56
child 55.4
different 43.9
room 43.2
picture frame 9.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 86.9%
Fear 2.1%
Surprised 1.3%
Angry 6%
Calm 34.5%
Sad 46.4%
Happy 0.7%
Disgusted 0.8%
Confused 8.4%

AWS Rekognition

Age 0-3
Gender Female, 52.6%
Sad 45%
Surprised 45%
Angry 45%
Confused 45%
Fear 45%
Happy 52.6%
Calm 47.2%
Disgusted 45%

AWS Rekognition

Age 0-3
Gender Male, 53.2%
Happy 45%
Fear 45.2%
Disgusted 45%
Angry 45.1%
Surprised 45%
Sad 54.6%
Confused 45%
Calm 45%

AWS Rekognition

Age 6-16
Gender Female, 55%
Angry 45%
Confused 45%
Disgusted 45%
Happy 46.1%
Sad 45%
Fear 45%
Calm 53.7%
Surprised 45%

AWS Rekognition

Age 21-33
Gender Female, 55%
Disgusted 45%
Happy 45.6%
Angry 45%
Confused 45%
Calm 54.2%
Fear 45%
Sad 45.1%
Surprised 45%

AWS Rekognition

Age 23-35
Gender Male, 53.2%
Happy 46.6%
Fear 45%
Disgusted 45%
Angry 45%
Surprised 45%
Sad 45%
Confused 45%
Calm 53.3%

AWS Rekognition

Age 23-37
Gender Male, 54.3%
Disgusted 45.1%
Sad 45.1%
Calm 53.2%
Fear 45%
Happy 45.1%
Confused 45%
Angry 46.3%
Surprised 45.1%

AWS Rekognition

Age 31-47
Gender Male, 54.1%
Surprised 45%
Disgusted 45%
Happy 45%
Sad 45.4%
Calm 52.2%
Confused 45.1%
Fear 45%
Angry 47.1%

AWS Rekognition

Age 4-12
Gender Female, 51.2%
Surprised 45.1%
Fear 45.8%
Happy 45.1%
Sad 50%
Calm 47.8%
Disgusted 45.1%
Angry 45.4%
Confused 45.5%

AWS Rekognition

Age 8-18
Gender Female, 54.3%
Calm 48.7%
Surprised 45.3%
Angry 45.5%
Confused 45.3%
Happy 48.7%
Fear 45.2%
Sad 46%
Disgusted 45.3%

AWS Rekognition

Age 12-22
Gender Female, 53.9%
Fear 45%
Disgusted 45%
Calm 54.9%
Angry 45%
Sad 45%
Surprised 45%
Happy 45%
Confused 45%

AWS Rekognition

Age 32-48
Gender Female, 54.6%
Calm 54.6%
Sad 45.1%
Happy 45%
Angry 45.1%
Fear 45%
Surprised 45%
Confused 45%
Disgusted 45.1%

AWS Rekognition

Age 31-47
Gender Female, 54.5%
Surprised 45.1%
Happy 45.1%
Confused 45.4%
Sad 48%
Angry 45.6%
Fear 45.1%
Disgusted 45.4%
Calm 50.4%

AWS Rekognition

Age 5-15
Gender Female, 54.5%
Disgusted 45%
Surprised 45%
Happy 45.1%
Sad 45.4%
Angry 45.2%
Fear 45%
Calm 54.2%
Confused 45%

AWS Rekognition

Age 15-27
Gender Female, 54.6%
Surprised 45.2%
Happy 45.1%
Confused 45.9%
Sad 47.2%
Angry 45.4%
Fear 45.2%
Disgusted 45.4%
Calm 50.7%

AWS Rekognition

Age 1-7
Gender Female, 53.9%
Fear 45%
Sad 45%
Disgusted 45%
Happy 54.7%
Angry 45.1%
Calm 45%
Surprised 45%
Confused 45.1%

AWS Rekognition

Age 47-65
Gender Female, 54.9%
Happy 52.4%
Confused 45.1%
Calm 47.2%
Fear 45%
Angry 45.1%
Surprised 45%
Disgusted 45.1%
Sad 45.1%

AWS Rekognition

Age 49-67
Gender Male, 54.7%
Disgusted 45%
Confused 45%
Angry 54.7%
Sad 45.2%
Happy 45%
Surprised 45%
Calm 45.1%
Fear 45%

AWS Rekognition

Age 12-22
Gender Female, 53.5%
Calm 50.4%
Disgusted 45%
Happy 45%
Fear 45%
Surprised 45%
Sad 49.3%
Confused 45%
Angry 45.2%

AWS Rekognition

Age 12-22
Gender Female, 53.6%
Confused 45%
Calm 54.5%
Surprised 45.1%
Fear 45%
Happy 45.1%
Angry 45.2%
Sad 45.1%
Disgusted 45%

AWS Rekognition

Age 28-44
Gender Male, 54.9%
Sad 45.1%
Calm 54.5%
Angry 45%
Fear 45%
Happy 45.2%
Confused 45%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 5-15
Gender Female, 54.3%
Confused 45%
Surprised 45%
Calm 54.8%
Fear 45%
Disgusted 45%
Happy 45%
Sad 45.1%
Angry 45%

AWS Rekognition

Age 26-42
Gender Female, 54.6%
Disgusted 45.2%
Happy 45.4%
Confused 45.3%
Angry 45.4%
Fear 45.1%
Sad 45.1%
Calm 53.1%
Surprised 45.4%

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Poster
Person 99.6%
Person 99.4%
Person 99.3%
Person 98.5%
Person 97.2%
Person 96.8%
Person 96.5%
Person 93.4%
Person 92.7%
Person 90.8%
Person 88%
Person 86.2%
Person 76.3%
Person 65%
Person 60.9%
Person 53.8%
Tie 92.2%
Poster 52.8%

Categories

Imagga

paintings art 99.2%

Text analysis

Amazon

A
00ve9erh

Google

MJIR 3TARTI
MJIR
3TARTI