Human Generated Data

Title

Untitled (two photographs: large group portrait of young men and women in light formal wear standing in field; man with moustache and woman in black dress and hat posed in front of fireplace)
Date

1937, printed later
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10272

Human Generated Data

Title

Untitled (two photographs: large group portrait of young men and women in light formal wear standing in field; man with moustache and woman in black dress and hat posed in front of fireplace)

People

Artist: Martin Schweig, American 20th century

Date

1937, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10272

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Apparel 98.2
Clothing 98.2
Human 95.9
Person 95.9
Person 95.4
Art 93.3
Canvas 60.5
Accessories 59.4
Tie 59.4
Accessory 59.4
Art Gallery 59.4
Scarf 57.4
Feather Boa 57.4
Text 55.2

Clarifai
created on 2019-11-16

people 99.8
man 98.2
adult 97.8
woman 97.4
group 95.5
wear 94.5
group together 92.8
street 90.8
child 89.6
two 88.6
outfit 86.6
veil 82.6
one 81.7
vehicle 80.2
three 79
four 77.2
winter 77
music 75.8
many 75.7
several 73.9

Imagga
created on 2019-11-16

sliding door 65.2
door 53.9
movable barrier 39.8
window 36.9
barrier 27.7
black 21.8
framework 19.1
silhouette 18.2
man 17.5
male 14.9
supporting structure 14.4
obstruction 14.3
people 13.9
person 13.6
water 12
art 11.7
old 11.1
grunge 10.2
glass 10.1
light 10
vintage 9.9
frame 9.5
screen 9.2
business 9.1
building 8.9
office 8.8
urban 8.7
adult 8.5
portrait 8.4
alone 8.2
retro 8.2
sunset 8.1
sexy 8
businessman 7.9
hair 7.9
design 7.9
architecture 7.8
sky 7.7
pattern 7.5
sport 7.5
indoor 7.3
world 7.3
body 7.2
open 7.2
trees 7.1
posing 7.1
face 7.1
modern 7

Google
created on 2019-11-16

Photograph 96.5
White 95.9
Black 94.5
Black-and-white 93.8
Photographic paper 93.3
Snapshot 88.5
Monochrome 82.6
Monochrome photography 82
Picture frame 78.8
Photography 78
Tree 77.8
Room 71.4
Stock photography 67.6
Art 62.5
Style 55.5

Microsoft
created on 2019-11-16

text 97.1
clothing 91.9
black and white 83.5
woman 80.7
window 80.2
person 78
dress 76.5
wedding dress 69.5
bride 61.7
white 61.5
footwear 53.4
flower 52.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 12-22
Gender Male, 54.5%
Surprised 45.1%
Fear 45.1%
Angry 45.1%
Happy 52.7%
Sad 45.1%
Confused 45.2%
Calm 46.6%
Disgusted 45.2%

AWS Rekognition

Age 25-39
Gender Female, 55%
Happy 53.7%
Fear 45%
Sad 45%
Confused 45%
Disgusted 45.1%
Surprised 45%
Calm 46.1%
Angry 45%

AWS Rekognition

Age 39-57
Gender Female, 50.5%
Sad 49.6%
Surprised 49.5%
Angry 49.5%
Confused 49.5%
Fear 49.5%
Happy 50.2%
Calm 49.6%
Disgusted 49.5%

AWS Rekognition

Age 20-32
Gender Male, 50.5%
Surprised 49.5%
Angry 49.5%
Happy 49.5%
Fear 49.5%
Calm 49.6%
Disgusted 49.5%
Sad 49.5%
Confused 50.4%

AWS Rekognition

Age 35-51
Gender Male, 50.3%
Sad 49.9%
Calm 50.1%
Angry 49.5%
Fear 49.5%
Happy 49.5%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 19-31
Gender Female, 50.1%
Happy 49.5%
Fear 49.6%
Sad 49.5%
Confused 50.2%
Disgusted 49.5%
Surprised 49.7%
Calm 49.5%
Angry 49.5%

AWS Rekognition

Age 14-26
Gender Female, 50.4%
Fear 49.7%
Calm 49.5%
Angry 49.6%
Happy 49.5%
Confused 49.6%
Disgusted 49.5%
Sad 50%
Surprised 49.6%

AWS Rekognition

Age 21-33
Gender Male, 50.5%
Angry 49.7%
Sad 49.5%
Happy 49.5%
Disgusted 49.5%
Calm 50%
Confused 49.8%
Surprised 49.5%
Fear 49.5%

AWS Rekognition

Age 21-33
Gender Female, 50.3%
Angry 49.5%
Happy 49.5%
Disgusted 49.5%
Sad 50.1%
Calm 49.6%
Surprised 49.5%
Confused 49.6%
Fear 49.7%

AWS Rekognition

Age 23-37
Gender Male, 50.4%
Sad 49.5%
Fear 49.6%
Angry 50.4%
Surprised 49.5%
Confused 49.5%
Calm 49.5%
Happy 49.5%
Disgusted 49.5%

AWS Rekognition

Age 20-32
Gender Female, 50%
Sad 49.5%
Disgusted 49.5%
Surprised 49.6%
Happy 49.5%
Angry 49.5%
Fear 50.1%
Confused 49.7%
Calm 49.5%

AWS Rekognition

Age 22-34
Gender Male, 50.4%
Happy 49.5%
Fear 50.1%
Angry 49.6%
Confused 49.6%
Calm 49.7%
Disgusted 49.5%
Surprised 49.6%
Sad 49.5%

AWS Rekognition

Age 23-37
Gender Male, 50.4%
Calm 49.6%
Disgusted 49.5%
Happy 49.5%
Fear 49.5%
Surprised 49.6%
Sad 49.5%
Confused 49.9%
Angry 49.8%

AWS Rekognition

Age 18-30
Gender Male, 50.3%
Sad 49.7%
Disgusted 49.5%
Fear 49.6%
Angry 49.5%
Happy 49.5%
Surprised 49.5%
Calm 50%
Confused 49.6%

AWS Rekognition

Age 13-23
Gender Male, 50.4%
Fear 49.7%
Surprised 50.1%
Confused 49.5%
Sad 49.5%
Disgusted 49.5%
Happy 49.5%
Calm 49.5%
Angry 49.6%

AWS Rekognition

Age 31-47
Gender Male, 50.4%
Fear 49.5%
Angry 49.6%
Sad 49.6%
Happy 49.5%
Calm 49.6%
Confused 50.2%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 42-60
Gender Female, 50.3%
Confused 50.1%
Surprised 49.5%
Happy 49.5%
Calm 49.7%
Disgusted 49.5%
Sad 49.5%
Angry 49.5%
Fear 49.5%

AWS Rekognition

Age 13-25
Gender Male, 50.5%
Disgusted 49.5%
Angry 49.5%
Calm 49.8%
Surprised 49.5%
Sad 49.7%
Confused 49.9%
Fear 49.5%
Happy 49.5%

AWS Rekognition

Age 36-52
Gender Female, 50.4%
Confused 49.6%
Angry 49.5%
Surprised 49.7%
Calm 49.9%
Disgusted 49.5%
Fear 49.6%
Sad 49.6%
Happy 49.7%

AWS Rekognition

Age 24-38
Gender Male, 50.3%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 49.5%
Confused 49.5%
Calm 49.5%
Fear 50.4%
Happy 49.5%

AWS Rekognition

Age 36-54
Gender Female, 50.3%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Fear 50.4%
Happy 49.5%
Angry 49.5%
Sad 49.5%
Disgusted 49.5%

AWS Rekognition

Age 34-50
Gender Female, 50.1%
Confused 49.8%
Happy 49.5%
Disgusted 49.6%
Calm 49.5%
Angry 49.7%
Sad 49.8%
Surprised 49.6%
Fear 49.6%

AWS Rekognition

Age 7-17
Gender Male, 50.2%
Surprised 49.5%
Sad 49.5%
Confused 50.5%
Happy 49.5%
Disgusted 49.5%
Fear 49.5%
Angry 49.5%
Calm 49.5%

AWS Rekognition

Age 13-23
Gender Male, 50.5%
Happy 49.5%
Confused 49.7%
Calm 49.6%
Angry 49.7%
Disgusted 49.5%
Surprised 49.6%
Fear 49.9%
Sad 49.5%

AWS Rekognition

Age 34-50
Gender Female, 50.5%
Angry 49.5%
Surprised 49.6%
Disgusted 49.5%
Confused 49.9%
Fear 49.8%
Calm 49.5%
Happy 49.6%
Sad 49.5%

AWS Rekognition

Age 6-16
Gender Male, 50.3%
Surprised 49.5%
Fear 49.6%
Disgusted 49.5%
Calm 49.6%
Angry 50.2%
Confused 49.6%
Happy 49.5%
Sad 49.5%

AWS Rekognition

Age 33-49
Gender Male, 50.4%
Angry 49.5%
Sad 50%
Confused 49.6%
Surprised 49.5%
Happy 49.6%
Disgusted 49.5%
Calm 49.6%
Fear 49.7%

AWS Rekognition

Age 30-46
Gender Male, 50.4%
Sad 49.5%
Surprised 49.7%
Angry 49.5%
Calm 49.7%
Happy 49.5%
Fear 49.8%
Disgusted 49.5%
Confused 49.7%

AWS Rekognition

Age 32-48
Gender Male, 50.3%
Fear 49.8%
Sad 49.7%
Happy 49.5%
Disgusted 49.5%
Calm 49.6%
Confused 49.6%
Angry 49.8%
Surprised 49.5%

AWS Rekognition

Age 27-43
Gender Male, 50.5%
Disgusted 49.5%
Fear 49.5%
Confused 50.4%
Angry 49.5%
Calm 49.5%
Surprised 49.5%
Sad 49.5%
Happy 49.5%

AWS Rekognition

Age 33-49
Gender Female, 50%
Sad 49.6%
Calm 49.7%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Angry 50.2%
Fear 49.5%

AWS Rekognition

Age 26-42
Gender Female, 50%
Disgusted 49.5%
Happy 49.5%
Angry 49.5%
Fear 50.1%
Sad 49.8%
Surprised 49.5%
Confused 49.6%
Calm 49.5%

AWS Rekognition

Age 21-33
Gender Male, 50.3%
Happy 49.5%
Fear 50.3%
Disgusted 49.5%
Angry 49.5%
Surprised 49.5%
Sad 49.6%
Confused 49.6%
Calm 49.5%

AWS Rekognition

Age 30-46
Gender Female, 50.1%
Calm 49.5%
Sad 49.5%
Happy 49.5%
Angry 49.5%
Surprised 49.5%
Confused 50.4%
Disgusted 49.5%
Fear 49.6%

AWS Rekognition

Age 35-51
Gender Male, 50.1%
Sad 50.4%
Fear 49.5%
Disgusted 49.5%
Surprised 49.5%
Angry 49.5%
Calm 49.5%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 12-22
Gender Male, 50.3%
Angry 49.6%
Happy 49.5%
Disgusted 49.5%
Calm 49.5%
Fear 49.5%
Surprised 49.5%
Sad 49.5%
Confused 50.3%

AWS Rekognition

Age 23-35
Gender Male, 50.2%
Surprised 49.6%
Sad 49.5%
Confused 49.7%
Calm 49.8%
Happy 49.8%
Angry 49.6%
Fear 49.5%
Disgusted 49.6%

AWS Rekognition

Age 36-54
Gender Male, 50.4%
Happy 49.5%
Disgusted 49.7%
Angry 49.6%
Fear 49.5%
Calm 49.7%
Surprised 49.6%
Sad 49.6%
Confused 49.8%

AWS Rekognition

Age 43-61
Gender Male, 50.5%
Angry 49.5%
Calm 49.5%
Confused 50.4%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Sad 49.5%
Fear 49.5%

AWS Rekognition

Age 42-60
Gender Male, 50.4%
Calm 49.6%
Fear 49.5%
Disgusted 49.6%
Surprised 49.5%
Happy 49.5%
Angry 49.6%
Confused 49.7%
Sad 50%

AWS Rekognition

Age 32-48
Gender Female, 50.3%
Happy 49.5%
Angry 49.6%
Disgusted 49.5%
Confused 49.5%
Sad 49.7%
Calm 49.5%
Surprised 49.5%
Fear 50%

AWS Rekognition

Age 41-59
Gender Male, 50.4%
Happy 49.5%
Fear 49.7%
Sad 49.6%
Confused 49.6%
Disgusted 49.5%
Surprised 49.6%
Calm 49.8%
Angry 49.7%

AWS Rekognition

Age 19-31
Gender Male, 50.1%
Fear 49.5%
Sad 49.6%
Happy 50%
Calm 49.6%
Angry 49.6%
Surprised 49.5%
Disgusted 49.5%
Confused 49.6%

AWS Rekognition

Age 14-26
Gender Male, 50.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Confused 49.6%
Sad 49.5%
Fear 49.6%
Angry 50.2%
Calm 49.5%

AWS Rekognition

Age 31-47
Gender Male, 50.4%
Surprised 49.5%
Disgusted 49.5%
Sad 49.5%
Angry 49.5%
Calm 50.3%
Happy 49.5%
Fear 49.5%
Confused 49.6%

AWS Rekognition

Age 22-34
Gender Male, 50.3%
Calm 49.5%
Surprised 49.5%
Disgusted 49.6%
Happy 49.5%
Angry 49.5%
Confused 50.2%
Sad 49.5%
Fear 49.6%

AWS Rekognition

Age 16-28
Gender Male, 50.4%
Happy 49.5%
Disgusted 49.7%
Confused 49.6%
Calm 50%
Fear 49.6%
Sad 49.6%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 33-49
Gender Male, 50.4%
Confused 49.5%
Surprised 49.6%
Calm 49.5%
Fear 50.3%
Disgusted 49.5%
Happy 49.5%
Sad 49.5%
Angry 49.5%

AWS Rekognition

Age 27-43
Gender Male, 50.5%
Happy 49.5%
Disgusted 49.5%
Confused 49.6%
Calm 49.5%
Fear 49.5%
Sad 49.5%
Angry 49.5%
Surprised 50.4%

AWS Rekognition

Age 29-45
Gender Male, 50.1%
Fear 49.8%
Angry 49.6%
Calm 49.8%
Happy 49.5%
Sad 49.6%
Disgusted 49.7%
Confused 49.5%
Surprised 49.6%

AWS Rekognition

Age 2-8
Gender Male, 50.1%
Fear 49.5%
Surprised 49.5%
Angry 49.6%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Sad 50.4%
Calm 49.5%

AWS Rekognition

Age 34-50
Gender Male, 50.5%
Sad 49.5%
Disgusted 49.5%
Fear 50.5%
Angry 49.5%
Happy 49.5%
Surprised 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 38-56
Gender Male, 50.4%
Angry 50%
Calm 49.7%
Happy 49.5%
Sad 49.5%
Fear 49.5%
Surprised 49.5%
Disgusted 49.6%
Confused 49.6%

AWS Rekognition

Age 18-30
Gender Male, 50.5%
Sad 49.5%
Disgusted 49.5%
Surprised 49.6%
Happy 49.5%
Angry 50%
Fear 49.5%
Confused 49.6%
Calm 49.8%

AWS Rekognition

Age 21-33
Gender Male, 50.3%
Fear 49.6%
Sad 49.8%
Disgusted 49.6%
Surprised 49.5%
Calm 49.7%
Happy 49.5%
Angry 49.6%
Confused 49.6%

AWS Rekognition

Age 45-63
Gender Male, 50.4%
Fear 49.9%
Angry 49.6%
Calm 49.6%
Surprised 49.6%
Happy 49.5%
Confused 49.7%
Sad 49.6%
Disgusted 49.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.9%
Tie 59.4%

Categories

Imagga

paintings art 83.4%
streetview architecture 14%
events parties 1.3%

Text analysis

Google

yeLY MITBE EITH
yeLY
MITBE
EITH