Human Generated Data

Title

Untitled (boy and girl in front of house)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17322

Human Generated Data

Title

Untitled (boy and girl in front of house)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17322

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Shorts 100
Clothing 100
Apparel 100
Person 99.9
Human 99.9
Shoe 99.8
Footwear 99.8
Person 99.8
Shoe 97
Shoe 94.3
Kid 75.7
Child 75.7
Window 71
Door 61.7
Girl 58.2
Female 58.2
Face 58.1
Pants 57.8
Staircase 55.2
Boy 55

Clarifai
created on 2023-10-29

people 99.7
monochrome 99.4
child 98.9
two 98.5
girl 97.8
man 97.7
woman 97.3
window 97.3
family 97.2
boy 97
portrait 95.4
adult 94.7
love 93.8
street 93.3
son 93
fun 90.3
walk 90.1
couple 90
three 85.7
actor 82.8

Imagga
created on 2022-02-26

sill 28.4
structural member 22.5
support 20.2
architecture 19.9
man 18.8
building 18.6
portrait 18.1
people 16.7
window screen 16.4
door 16.4
person 16
adult 15.6
screen 15.2
city 15
male 15
window 14.8
column 14
device 13.8
old 13.2
statue 12.8
business 12.7
house 12.5
sculpture 12.4
urban 12.2
protective covering 12.2
sliding door 11.4
fashion 11.3
happy 11.3
corporate 11.2
stone 11
human 10.5
face 9.9
office 9.9
attractive 9.8
boy 9.6
historical 9.4
wall 9.4
covering 9.2
historic 9.2
structure 9.1
dress 9
suit 9
history 8.9
posing 8.9
women 8.7
ancient 8.6
windows 8.6
travel 8.5
monument 8.4
street 8.3
makeup 8.2
look 7.9
smile 7.8
black 7.8
art 7.8
men 7.7
modern 7.7
pretty 7.7
world 7.6
hand 7.6
stairs 7.5
child 7.5
outdoors 7.5
one 7.5
vintage 7.4
tourism 7.4
detail 7.2
movable barrier 7.2
lifestyle 7.2
hair 7.1
family 7.1
businessman 7.1

Google
created on 2022-02-26

Building 92.5
Window 90.2
Shorts 89
Standing 86.4
Gesture 85.3
Black-and-white 85
Style 84
Tints and shades 77.3
Door 77
Rectangle 76.7
Monochrome 76.7
Monochrome photography 76
Art 70.7
Symmetry 69.4
Room 68.3
Street 64.5
Shadow 63.5
House 63.5
Stock photography 63.1
Fun 62.8

Microsoft
created on 2022-02-26

clothing 97
footwear 93.5
window 92.2
person 91.8
black and white 87.5
boy 77.8
window blind 67.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Female, 99.8%
Calm 89.9%
Happy 4.8%
Angry 2.4%
Sad 1.3%
Disgusted 0.7%
Confused 0.5%
Surprised 0.4%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Male, 94.1%
Sad 51.1%
Surprised 22.4%
Happy 17.1%
Calm 4.4%
Confused 1.8%
Disgusted 1.2%
Fear 1.2%
Angry 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Staircase
Person 99.9%
Person 99.8%
Shoe 99.8%
Shoe 97%
Shoe 94.3%
Staircase 55.2%

Categories

Imagga

interior objects 68.8%
streetview architecture 30.1%
paintings art 1%

Text analysis

Google

YT33A8-XAGO
YT33A8-XAGO